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ABSTRACT 


We  develop  a  method  to  approximately  solve  a  large  staircase  linear  program  that 
optimizes  decisions  over  time.  Also  developed  is  a  method  to  bound  that  approximation’s 
error.  A  feasible  solution  is  derived  by  a  proximal  cascade,  which  sequentially  considers 
overlapping  subsets  of  the  model’s  time  periods,  or  other  ordinally  defined  set.  In  turn,  we 
bound  the  cascade’s  deviation  from  the  optimal  objective  value  by  a  Lagrangian  cascade, 
which  penalizes  infeasibility  by  incorporating  dual  information  provided  by  the  proximal 
cascade  solution.  When  tested  on  a  large  temporal  LP  developed  for  US  Air  Force  mobility 
plaimers,  we  often  observe  gaps  between  the  approximation  and  bound  of  less  than  10  per¬ 
cent,  and  save  as  much  as  80  percent  of  the  time  required  to  solve  the  original  problem.  We 
also  address  methods  to  reduce  the  gap,  including  constraint  extension  of  the  Lagrangian 
cascade,  as  well  as  exploitation  of  dual  multipliers  within  the  proximal  cascade. 
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EXECUTIVE  SUMMARY 


This  dissertation  develops  techniques  to  solve  very  large  instances  of  a  linear  pro¬ 
gram  that  optimizes  US  Air  Force  (USAF)  strategic  and  tactical  airlift  for  regional  con¬ 
tingencies.  Until  recently,  simulation  and  spreadsheet  models  were  used  for  airlift  analysis 
because  sufficiently  detailed  optimization  models  were  intractable  due  to  their  size.  In  order 
to  facilitate  the  use  of  highly  detailed  mobility  optimizations,  we  develop  the  proximal  cas¬ 
cade,  which  approximates  the  solution  of  large  linear  programs  that  involve  decisions  over 
time,  location,  or  priority,  also  develop  the  Lagrangian  cascade,  which  quantitatively 
assesses  the  approximation’s  accuracy. 

A  linear  program  may  be  approximated  by  the  proximal  cascade  when  a  model’s 
decisions  directly  affect  only  proximal  decisions,  i.e.,  those  that  are  closely  related  by  some 
attribute  such  as  time.  A  proximal  cascade  first  considers  only  the  earliest  decision  periods 
of  a  model,  and  then  cascades  forward  in  time  to  consider  the  decisions  of  later  periods. 
The  number  of  periods  considered  by  each  stage,  or  cascade  subproblem,  is  often  limited 
by  the  computational  power  available.  Alternatively,  subproblem  size  can  be  determined 
by  the  level  of  future  uncertainty  encoimtered  in  the  system  being  modelled. 

We  assess  the  accuracy  of  the  proximal  cascade  by  the  Lagrangian  cascade.  La¬ 
grangian  cascades  also  consist  of  proximally  related  subproblems,  made  separable  by  not 
enforcing  resource  limitations  that  involve  the  time  periods  of  multiple  subproblems.  In¬ 
stead  of  explicit  enforcement,  these  resources  express  their  scarcity  by  charging  a  consump¬ 
tion  penalty,  similar  to  the  ones  used  in  the  proximal  cascade. 

A  proximal  cascade  solution  enforces  all  resource  limitations  in  one  or  more  sub¬ 
problems.  Therefore,  its  solution  does  not  violate  any  of  the  assumptions  made  by  the  model 
formulation.  However,  its  solution  may  not  be  the  best  possible,  because  it  is  encumbered 
by  not  being  able  to  consider  all  periods  at  once.  Conversely,  a  Lagrangian  cascade  may 
provide  a  solution  that  violates  resource  limitations,  but  is  more  economical  by  some  ob¬ 
jective  cost  measure  than  a  fully  constrained  solution.  Therefore,  the  two  cascade  objective 
costs  bound  the  optimal  objective  cost,  which  is  the  cost  when  all  periods  are  solved  at  once. 


The  two  cascades  are  also  related  by  consumption  penalties.  All  linear  programs 
yield  as  part  of  their  solution,  marginal  values  for  all  of  the  constraining  resources.  Marginal 
values  from  the  proximal  cascade  are  used  in  the  Lagrangian  cascade  as  appropriate  penalty 
levels  for  consumption  of  the  resources  whose  limits  are  not  enforced.  This  circumvents  a 
long  search  for  the  appropriate  penalties  that  frequently  hamper  similar  relaxation-penalty 
methods. 

The  Naval  Postgraduate  School/RAND  Mobility  Optimizer  (NRMO)  provides  an 
excellent  opportunity  to  test  proximal  and  Lagrangian  cascades.  This  model  is  the  latest  in 
an  evolution  of  linear  programing  optimization  models  that  address  the  increased  interest  in 
airlift  mobility  as  a  result  of  the  Gulf  ^^hr.  NRMO  optimizes  decisions  involving  numerous 
aspects  of  a  deployment,  including  strategic  airlift  mission  and  crew  assignments,  aerial 
refueling  missions,  intra-theater  deliveries,  and  recovery  options.  Consequently,  the  size  of 
this  model  can  be  huge. 

When  tested  on  several  NRMO  scenarios,  the  percentage  gap  between  the  proximal 
and  T  agrangian  cascade  objective  costs  is  often  within  10%.  In  other  words,  the  cost  of  the 
proximal  cascade  solution  is  within  10%  of  the  optimal  solution  cost.  Computation  times 
vary,  but  can  take  as  little  as  20%  of  the  time  required  to  solve  all  periods  at  once 

Cascades  provide  a  useful  approximation  and  bounding  strategy  for  linear  programs 
that  exhibit  a  proximal  decision  structure.  The  method  permits  solution  of  model  scenarios 
that  are  much  larger  than  are  otherwise  possible,  and  has  applicability  to  a  linear  program 
currently  in  use  by  the  USAF. 


I.  INTRODUCTION 


Large  mathematical  programs  often  require  indirect  solution  methods  that  exploit 
the  problem’s  structure.  When  the  variables  and  constraints  of  a  mathematical  program 
can  be  ordered  by  some  attribute  such  that  all  variables  vrithin  any  constraint  are  ordinally 
proximate,  that  mathematical  program  can  be  characterized  as  a  “staircase  model.”  The 
purpose  of  this  research  is  to  formalize  a  heuristic  that  exploits  the  structure  of  staircase 
linear  programs,  and  provide  a  bound  for  that  heuristic’s  accuracy.  Once  developed,  we  test 
the  heuristic  and  bound  on  a  large  linear  program  used  by  the  US  Air  Force  (USAF)  for  air 
mobility  analyses. 

Staircase  linear  optimization  models  are  widely  used  in  many  areas  such  as  schedul¬ 
ing,  where  decisions  of  a  given  time  period  directly  affect  only  the  decisions  of  proximal 
time  periods.  The  success  of  linear  and  integer  programming  (LP  and  ip  respectively)  in 
aiding  schedulers  is  well  known.  These  models  frequently  consider  a  large  but  finite  solu¬ 
tion  horizon  [^\hlker  and  Dell,  1995],  which  is  the  number  of  time  periods  included  in  a 
scheduling  model.  Unfortunately,  these  models  are  limited  by  temporal  considerations  in  at 
least  two  ways:  1)  a  distant  solution  horizon  may  make  gathering  accurate  data  for  the  latter 
periods  problematic,  and  2)  a  sufficiently  large  solution  horizon  may  produce  a  model  that 
is  too  large  to  solve.  Not  surprisingly,  a  human  scheduler  faces  the  same  difficulties,  namely 
reconciling  the  increasing  number  of  options  with  decreasing  certainty  as  the  solution  hori¬ 
zon  grows.  For  either  the  human  scheduler  or  the  optimization  model,  perhaps  the  most 
straightforward  way  of  dealing  with  the  difficulties  presented  by  a  large  problem  is  to  fo¬ 
cus  on  a  subset  of  the  problem’s  time  periods,  and  then  move  forward  to  a  new  subset.  This 
temporal  myopia,  or  inability  to  see  the  full  problem  at  any  one  point,  may  result  in  a  subop- 
timal  solution,  but  can  make  the  problem  simple  enough  to  solve.  Moreover,  a  model  that  is 
used  to  mimic  scheduling,  but  not  produce  schedules,  may  be  best  if  it  can  incorporate  the 
realism  of  myopic  scheduling.  For  example,  when  selecting  fleet  size  or  infrastructure  in 
order  to  maximize  a  delivery  system’s  effectiveness,  a  model  should  not  unduly  anticipate 
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delivery  requirements  far  into  the  future.  Thus,  myopia  is  a  desirable  model  characteristic 

whenever  perfect  foresight  is  unwarranted. 

Modeling  myopia  is  acceptable  and  realistic  provided  the  resource  commitments 
(constraints)  initiated  by  decisions  are  short  relative  to  the  solution  horizon.  In  an  LI5  this 
constraint-enforced  linkage  of  a  time  period’s  variables  only  to  nearby  periods  resembles  a 
staircase  along  the  main  diagonal  of  the  constraint  coefficient  matrix.  The  rest  of  the  co¬ 
efficient  matrix  is  relatively  sparse,  since  variables  associated  with  the  early  time  periods 
rarely  appear  in  constraints  corresponding  to  the  later  time  periods.  Thus,  temporarily  ig¬ 
noring  the  variables  and  constraints  associated  vvith  later  periods  may  have  only  a  small 
effect  on  the  “early”  portion  of  the  solution,  since  most  of  the  constraints  for  those  periods 

are  left  intact. 

Once  a  schedule  is  produced  for  a  limited  number  of  early  periods,  the  earliest  deci¬ 
sions  are  fixed,  and  the  model  “cascades”  forward  in  order  to  solve  for  a  later  set  of  periods. 

Webster’s  [1993,  p.  345]  defines  a  cascade  as: 

“A  succession  of  stages  (as  in  a  process  or  in  the  arrangement  of  the  parts 
of  an  apparatus)  in  which  each  stage  derives  from  or  acts,  sometimes  cumu¬ 
latively,  upon  the  product  or  output  of  the  preceding.” 

In  a  mathematical  program,  a  cascade  implies  generating  a  feasible  solution  by  solving 
only  a  subset  of  a  problem’s  constraints  and  variables,  and  then  moving  to  a  new  subset 
corresponding  to  later  time  periods.  Each  of  these  cascade  subproblems  should  re-solve 
a  portion  of  the  previous  subproblem  in  order  to  minimize  the  end  effects  caused  by  the 
temporal  limitation.  This  method  of  approximating  an  LP  solution  was  first  suggested  by 
Chames  and  Cooper  [1961,  pp.  370-388],  and  is  often  used  to  truncate  problems  with 
a  theoretically  infinite  number  of  time  periods.  In  contrast,  a  goal  of  this  research  is  to 
implement  a  proximal  cascade  heuristic;  a  heuristic  that  sequentially  selects  and  solves 
portions  of  a  model  whose  variables  and  constraints  are  finitely  indexed  by  an  ordinally 
defined  set  such  as  time  periods. 

The  closeness  of  a  proximal  cascade  approximation  to  the  overall  LP  solution  is 
dependent  on  many  scenario-specific  factors.  In  order  to  supplement  the  proximal  cascade 
approximation,  this  research  also  develops  an  optimistic  bound  on  the  LPs  solution  value 
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by  exploiting  information  derived  from  the  proximal  cascade.  When  ordered  by  a  time 
index,  staircase  LPs  may  have  constraints  that  link  only  proximal  time  periods;  relaxing  the 
constraints  associated  with  certain  time  periods  can  decouple  a  large  problem  into  several 
subproblems.  Lagrangian  relaxation  has  long  been  used  for  this;  it  discourages  violation 
of  relaxed  constraints  through  penalties.  The  Lagrangian  penalty  is  applied  to  a  series  of 
separable  problems,  and  an  optimistic  bound  for  the  solution’s  objective  value  is  derived. 
Unfortunately,  finding  the  correct  penalty  values  for  relaxed  constraints  is  often  as  difficult 
as  solving  the  problem  vdthout  the  relaxation.  However,  this  research  shows  that  reasonable 
penalties  for  the  relaxed  constraints  are  readily  available  from  the  “shadow  prices  of  a 
proximal  cascade  solution.  A  Lagrangian  cascade  produces  a  bound  on  the  LP  solution 
by  incorporating  the  proximal  cascade  penalties  into  a  series  of  decoupled  subproblems. 
When  combined  with  the  proximal  cascade  approximation,  the  size  of  the  gap  between  the 
two  values  gives  a  quantitative  assessment  of  proximal  cascade  accuracy. 

Once  developed,  we  demonstrate  proximal  and  Lagrangian  cascades  on  a  large  LP 
currently  in  use  by  USAF  analysts  for  mobility  planning.  This  model,  under  development 
concurrent  with  the  cascade  research,  defies  the  long  held  opinion  among  many  Air  Force 
planners  that  LPs  with  sufficient  detail  to  model  the  underlying  mobility  system  are  cur¬ 
rently  intractable  due  to  their  size.  Proximal  and  Lagrangian  cascades  provide  a  methodol- 
ogy  by  which  to  allay  that  criticism,  and  are  examined  in  this  research  using  instances  of 
the  mobility  LP 

A  cascade  can  be  used  on  a  wide  variety  of  problems  for  several  different  reasons, 
and  may  often  be  improved  by  altering  problem  structure  or  further  exploiting  dual  infor¬ 
mation.  We  complete  this  research  by  examining  how  cascade  performance  on  general  LPs 
can  be  predicted  and  enhanced. 

A.  LITERATURE  REVIEW 

The  topics  germane  to  the  research  include  decomposition  of  large  LPs,  Lagrangian 
relaxation,  time-based  or  proximal  methods,  and  military  mobility  optimization.  While 
there  is  a  wealth  of  literature  on  decomposition  and  Lagrangian  relaxation,  proximal  meth- 
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ods  and  military  mobility  optimization  are  sparsely  documented.  Below  is  a  summary  of 
the  literature. 


1.  Decomposition 

The  notion  of  incorporating  dual  information  to  decompose  large  linear  programs 
into  smaller,  structured  LPs  originated  with  Dantzig  and  Wfe  [1 960],  and  Benders  [1962]. 
Both  methods  rely  on  passing  primal  and  dual  information  between  a  master  problem, 
which  addresses  the  original  problem  in  a  simplified  form,  and  one  or  more  subproblems, 
which  address  portions  of  the  problem  in  detail.  These  subproblems  often  exhibit  a  compu¬ 
tationally  exploitable  structure. 

In  Dantzig-\\blfe  decomposition,  the  subproblems  use  dual  prices  from  the  master 
problem  in  order  to  derive  new  variables  for  the  master  problem  that  will  price  favorably 
in  subsequent  iterations.  In  turn,  the  master  problem  takes  a  convex  combination  of  these 
new  variables  to  produce  a  feasible  solution  to  the  overall  problem,  as  well  as  new  resource 
prices  for  the  subproblems.  The  method  converges  when  the  subproblems  cannot  find  a 
variable  to  price  favorably  in  the  master  problem. 

Benders’  decomposition  of  an  LP  is  similar  in  many  respects  to  Dantzig- Wolfe  de¬ 
composition  since  the  Benders’  master  problem  is  the  dual  of  the  Dantzig-Wolfe  master 
problem.  Consequently,  instead  of  solving  the  master  problem  with  a  subset  of  variables 
(as  in  Dantzig-Wolfe),  the  Benders’  master  problem  solves  a  subset  of  cuts  derived  from 
a  reformulation  of  original  constraints,  but  in  the  dual.  In  turn,  the  Benders’  decomposi¬ 
tion  subproblems  use  the  current  master  problem  solution  to  produce  a  violated  constraint 
to  be  appended  to  the  next  master  problem  iteration.  The  method  has  converged  when  the 
subproblem  solution  can  no  longer  find  a  violated  constraint. 

Geofti-ion  and  Graves  [1974]  use  Benders’  decomposition  to  reduce  a  mixed  mteger, 
multi-commodity  transportation  problem  into  separable  single  commodity  problems.  In  this 
formulation,  the  master  problem  dictates  the  configuration  of  the  integer  variables  based  on 
cost  information  from  the  subproblems,  while  the  subproblems  determine  the  flows  based 
on  the  network  provided  by  the  master  problem.  Brown,  Graves,  and  Honczarenko  [1987] 
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extend  this  technique  using  elastic  constraints  to  insure  feasibility  as  well  as  improve  con¬ 
vergence. 

Decomposition  has  also  been  applied  to  staircase  linear  programs  by  Glassey  [1973] 
as  well  as  Ho  and  Manne  [1974].  Their  method  repeatedly  applies  the  Dantzig-Wolfe  tech¬ 
nique  to  succeeding  (or  preceding)  levels  of  a  staircase  LP,  forming  a  “nested”  decompo¬ 
sition.  Each  new  staircase  level  acts  as  the  next  subproblem,  which  feeds  back  pricing  in¬ 
formation  to  its  master  (the  previous  staircase  level),  while  sending  variable  levels  forward 
to  the  next  staircase  level.  A  staircase  LP  can  also  be  decomposed  by  Benders’  method,  as 
shown  by  Van  Slyke  and  Wets  [1969]  for  two-stage  stochastic  programming,  and  later  by 
Birge  [1985]  for  multi-stage  stochastic  programming. 

Although  not  a  decomposition  technique,  the  solution  of  large-scale  LPs  can  also  be 
approximated  by  aggregation  of  time  periods  until  a  problem  of  workable  size  is  derived. 
Zipkin  [1980]  describes  a  methodology  for  bounding  the  error  incurred  by  such  aggregation 
in  some  problems.  Although  the  idea  has  merit  for  large  models,  and  has  been  used  to 
solve  problems  similar  to  the  one  described  in  this  research,  it  has  no  direct  applicability  to 
proximal  and  Lagrangian  cascades. 

2.  Lagrangian  Relaxation 

Lagrangian  relaxation  is  used  in  many  optimization  applications,  including  vehicle 
routing,  scheduling,  and  network  design  problems  \e.g.,  Ahuja,  Magnanti,  and  Orlin,  1993, 
pp.  620-635].  Common  to  these  methods  is  a  search  for  accurate  Lagrangian  penalties  of 
the  relaxed  constraints,  which  has  proved  the  most  difficult  aspect  of  the  overall  method. 
Parker  and  Rardin  [1988,  pp.  205-237],  as  well  as  Bazaraa,  Sherali,  and  Shetty  [1993,  pp. 
199-231]  give  a  summary  of  the  search  techniques.  A  Lagrangian  cascade  requires  none  of 
these  techniques,  since  the  Lagrangian  penalties  are  a  by-product  of  the  proximal  cascade. 
However,  further  tightening  of  the  Lagrangian  cascade  bound  could  benefit  from  multiplier 
search  techniques.  This  remains  a  subject  for  further  research. 


5 


3. 


Time-Based,  or  Proximal  Methods 


The  use  of  temporally  progressing  solution  strategies  in  optimization  is  of  two  va¬ 
rieties;  solution  cascading  and  forward  optimization.  Brown,  Graves,  and  Ronen  [1987] 
implement  solution  cascading  by  solving  successive  portions  of  a  model’s  time  periods  in 
order  to  produce  an  advanced  basis.  For  example,  a  problem  with  1 5  time  periods  is  split 
into  three  smaller  problems,  each  considering  only  rows  and  columns  indexed  with  peri¬ 
ods  1-5, 6-10,  and  11-15,  respectively.  The  optimal  solutions  of  these  subproblems  are  then 
used  to  suggest  columns  that  price  favorably,  as  well  as  produce  an  advanced,  or  “crash 
basis  for  the  original  problem.  With  this  “head  start,”  optimality  may  ensue  in  fewer  itera¬ 
tions.  Jayakumar  and  Ramasesh  [1994]  demonstrate  the  computational  savings  of  solution 
cascading  on  a  number  of  test  problems. 

Forward  optimization  as  outlined  by  Morton  [1981]  involves  solving  successively 
longer  (more  time  periods)  problems  until  a  decision  horizon  is  reached.  A  decision  horizon 
is  a  point  beyond  which  solving  larger  problems  will  not  alter  the  decisions  of  the  first  time 
period.  This  method  shows  that  (for  some  problems)  an  optimal  solution  can  be  reached  by 
solving  a  succession  of  small  LPs,  and  recording  the  values  within  each  as  optimal.  Aron¬ 
son  et  al.  [1985]  develop  and  test  this  idea  for  certain  classes  of  problems,  notably  from 
the  area  of  manufacturing.  Production  scheduling  problems  where  time  periods  are  linked 
only  by  inventory  level  exhibit  natural  decision  horizons  just  after  periods  of  maximum 
demand.  At  these  points  in  time,  inventories  are  exhausted,  effectively  restarting  the  pro¬ 
duction  schedule.  Thus,  forward  optimization  is  appealing  when  solving  certain  classes  of 
problems,  but  does  not  offer  general  applicability. 

Manne  [1970]  offers  related  work  on  limiting  the  temporal  horizon  of  an  LE  His 
research  provides  sufficient  conditions  for  optimality  when  truncating  infinite  horizon  LPs 
whose  coefficients  do  not  change  in  the  latter  periods.  \^hlker  [1995]  extends  this  idea 
to  bound  the  error  produced  by  truncating  infinite  horizon  LPs  prior  to  the  point  where 
Manne  showed  equivalency  between  finite  and  infinite  horizon  problems.  Unfortunately, 
the  infinite  horizon  method  requires  an  invariant  constraint  structure  beyond  a  specified 
time  period,  which  does  not  occur  in  all  staircase  problems.  There  is  no  body  of  literature 
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on  the  solution  and  bounding  of  large,  but  still  finite,  LPs  by  a  proximal  cascade,  which 
successively  solves  portions  of  a  non-homogeneous  staircase  LP  in  order  to  approximate 
an  otherwise  intractable  problem. 

4.  Military  Mobility  Optimization 

Dantzig  and  Fulkerson  [1954]  offered  the  first  application  of  mathematical  program¬ 
ming  to  time-dynamic  military  transportation  problems.  Their  work  scheduling  US  Navy 
tankers  was  seminal  for  military  logistics  optimization  as  well  as  time-dynamic  network 
transportation  problems. 

Until  recently,  the  computational  demands  of  LP  in  modeling  large-scale  Air  Force 
contingency  deployments  allowed  an  insufficient  level  of  detail  for  many  analyses.  Con¬ 
sequently,  simulation  was  the  method  of  choice  for  analyzing  fleet  mix  and  infrastructure 
requirements  of  such  a  deployment.  Wing  et  al.  [1991]  developed  a  time-dynamic  LP  as  a 
response  to  the  Mobility  Requirements  Study  mandated  by  the  National  Defense  Authoriza¬ 
tion  Act  of  1991.  %st  [1994]  continued  the  integration  of  LP  into  the  mobility  modeling 
arena  with  the  development  of  THRUPUT  in  1994,  which  offered  a  detailed  routing  struc¬ 
ture,  but  was  temporally  static.  Concurrent  -with  last’s  work,  the  RAND  Corporation  devel¬ 
oped  CONOP  [Killingsworth  and  Melody,  1994],  which  also  focused  on  airlift,  but  initially 
examined  the  efficacy  of  aerial  refueling  of  airlifters  in  a  contingency.  Lim  [1994],  Morton, 
Rosenthal,  and  Lim  [1995],  and  Rosenthal  et  al.  [1996]  extended  THRUPUT  with  the  de¬ 
velopment  of  THRUPUT  II,  which  incorporated  the  multiple  time  periods  into  Yost’s  work. 
Subsequently,  RAND’s  CONOP  model  and  THRUPUT  II  were  merged  into  the  Naval  Post¬ 
graduate  School/RAND  (NPS/RAND)  Mobility  Optimizer  [Rosenthal  et  al.,  1997],  which 
is  the  case  study  considered  in  this  dissertation. 

B.  EXPLANATION  OF  TERMS 

Several  key  terms  have  a  specific  meaning  in  this  research.  A  comprehensive  list 
follows: 
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Monolith:  A  formulation  a  linear  program.  Many  definitions  that  follow  consider  portions, 
or  subsets  of  the  monolith. 

Row:  A  constraint  of  the  monolith,  defined  by  its  indices,  technological  coefficients,  sense 
(<,  =,  or  >),  and  right  hand  side. 

Column:  A  variable  of  the  monolith,  defined  by  its  indices,  coefficients,  and  bounds. 
Association:  If  a  row  and  column  intersect  with  a  nonzero  technological  coefficient,  then 
they  are  said  to  be  associated. 

Cascade  index  set:  A  scalar  attribute  assigned  to  each  row  and  column.  The  scalar  may 
be  an  index,  or  a  distinguished  null  index  (conventionally  zero)  when  the  assignment  of  a 
specific  scalar  is  inappropriate  (this  occurs  if  a  row  or  column  has  no  correspondiiig  cascade 
index).  The  idea  is  to  assign  non-null  scalars  that  express  a  relation  or  proximity  among 
rows  and  columns  with  identical  or  nearly  identical  non-null  indices. 

Active  Index  Set:  A  distinguished  subset  of  contiguous  cascade  indices  and  the  null  mdex. 
Linkage:  A  row  associated  with  columns  endowed  with  distinct  cascade  indices  creates  a 
linkage  between  the  indices. 

Active  Row:  Row  endowed  with  an  active  cascade  index. 

Lagrange  Row:  Row  other  than  an  active  row  represented  only  by  its  Lagrangian  relaxation 
(referred  to  as  “Lagrange-relaxed”). 

Relaxed  Row:  Row  that  is  neither  active  nor  Lagrange-relaxed. 

Active  Column:  Column  endowed  with  an  active  cascade  index. 

Fixed  Column:  Not  an  active  column,  but  endowed  with  some  value  which  may  influence 
its  associated  rows.  A  fixed  column’s  value  equals  its  level  when  made  inactive,  or  zero  if 
the  column  has  never  been  active. 

Subproblem:  Active  rows  and  columns,  where  the  objective  may  include  terms  contributed 
by  Lagrange-relaxed  rows  and  fixed  columns,  and  the  right  hand  sides  may  be  influenced 
by  fixed  columns. 

Cascade:  A  sequence  of  subproblems.  The  motive  for  using  a  cascade  is  to  indirectly  as¬ 
semble  an  acceptable  answer  to  the  monolith  with  less  effort  than  an  outright  direct  attempt 
at  solution.  A  cascade  may,  or  may  not,  culminate  in  a  strictly  feasible,  optimal  solution  to 
the  monolith.  However,  prescribing  a  useful  solution  for  the  problem  fi-om  which  the  model 
monolith  derives  is  the  goal  and  guide. 

Width:  The  range  of  non-null  cascade  indices  active  in,  say,  a  subproblem  or  a  row. 
Overlap:  The  range  of  the  subset  of  non-null  cascade  indices  in  common  between,  say,  two 
subproblems  or  two  rows. 

Proximal  Cascade:  A  non-separating  sequence  of  subproblems,  each  of  which  has  width 
intentionally  constrained  to  represent  some  limited  effective  planning  horizon  less  that  the 
total  number  of  cascade  indices.  A  proximal  cascade  may  be  used  to  enhance  computa¬ 
tional  tractability,  or  to  temper  uirrealistic  omniscience  in  a  model  monolith  that  represents 
a  problem  that  would  in  reality  be  dealt  with  myopically. 
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Lagrangian  Cascade:  A  separating  sequence  of  subproblems  defined  by  exhaustive  par¬ 
tition  of  the  cascade  index  set  and  rendered  disjoint  by  Lagrangian  relaxation  of  any  row 
eissociated  with  two  or  more  subproblems. 

Gap  (absolute)  :  The  absolute  value  of  the  difference  between  the  proximal  and  Lagrangian 
cascade  objective  function  values. 

Solution  quality:  The  inverse  of  the  absolute  gap  between  the  monolith  objective  function 
value  and  the  (proximal  or  Lagrangian)  cascade  objective  function  value.  Solution  quality 
equals  infinity  when  this  absolute  gap  is  zero;  solution  quality  equals  zero  when  the  cascade 
is  infeasible  or  imbounded. 

Gap  (relative):  The  absolute  gap  divided  by  the  absolute  value  of  its  more  favorable  con¬ 
stituent  value  (the  lower  value  for  a  minimization  problem).  Relative  gaps  are  assumed 
herein. 

C.  OVERVIEW 

Chapter  II  develops  proximal  and  Lagrangian  cascade  theory.  The  context  used  is  a 
production  setting,  with  the  time  index  serving  as  the  cascade  index  set.  Rather  than  use  the 
simplest  staircase  model,  this  chapter  incorporates  formulation  complexities  that  ease  the 
transition  into  the  case  study.  Foremost  among  these  characteristics  is  “elastic  demand, 
which  serves  the  dual  purpose  of  supporting  the  case  study,  as  well  as  demonstrating  the 
flexibility  of  a  cascade  beyond  simple  staircase  models. 

Chapter  III  outlines  the  implementation  of  proximal  and  Lagrangian  cascades  by 
presenting  a  discussion  and  pseudocode  of  each.  The  remainder  of  the  chapter  considers 
the  ramifications  of  heuristic  parameter  selection  on  problem  feasibility  and  solution  quality. 

Chapter  IV  describes  the  USAF  mobility  model  under  development  at  NFS,  and 
gives  specific  formulations  for  the  proximal  and  Lagrangian  cascades.  Much  of  this  chapter 
reconciles  the  theoretical  development  with  the  inevitable  complexity  of  a  “real  world” 
model.  The  rest  of  the  chapter  describes  cascade  performance  on  a  number  of  problem 
instances. 

Chapter  V  generalizes  a  cascade  to  an  arbitrary  model,  and  offers  a  method  to  assess 
whether  a  model  cascade  might  produce  a  feasible  result  of  good  quality.  The  chapter  also 
discusses  what  conditions  suggest  whether  or  not  a  model  cascade  is  warranted.  Finally, 
the  chapter  considers  how  additional  dual  and  primal  information  may  be  incorporated  to 
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improve  cascade  solution  quality.  The  most  interesting  of  these  methods  uses  an  approach, 
similar  to  Benders’  decomposition,  to  iteratively  reduce  the  cascade  gap. 

The  research  is  concluded  in  Chapter  VI,  which  summarizes  the  theoretical  and 
computational  results.  Chapter  VI  also  suggests  future  opportunities  for  cascade  research. 
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II.  CASCADE  THEORETICAL  DEVELOPMENT 


This  chapter  introduces  and  develops  proximal  and  Lagrangian  cascades.  Although 
there  are  many  variations  of  staircase  problems,  this  research  principally  considers  a  schedul¬ 
ing  problem  that  is  formulated  as  an  elastic-demand  staircase  model.  To  that  end,  this 
chapter  first  derives  the  single-commodity,  elastic-demand  staircase  model  from  a  familiar 
production-scheduling  LE  Subsequently,  we  use  that  model  to  introduce  the  proximal  cas¬ 
cade  by  segmenting  it  into  smaller  pieces.  This  segmentation  produces  a  series  of  smaller 
problems  that  jointly  approximate  the  monolith.  Next,  we  develop  proximal  cascade  theory 
for  a  multi-commodity  elastic-demand  staircase  model,  as  well  as  for  a  generalized  stair¬ 
case  model  without  elastic  demands.  Finally,  the  chapter  introduces  Lagrangian  cascade 
theory,  which  provides  a  bound  on  the  monolith’s  optimal  objective  value. 

A.  SINGLE-COMMODITY  ELASTIC-DEMAND  STAIRCASE  LP 

Preliminary  use  of  a  simple  model  is  warranted.  Although  the  case  study  for  this 
research  focuses  on  a  military  mobility  scenario,  the  most  familiar  model  setting  involves 
scheduling  of  manufacturing  resources.  Consider  the  following  single-commodity 
production-scheduling  LP  with  elastic  demands,  multiple  period  lead  times,  and  no  inven¬ 
tory  costs.  In  this  case,  assume  the  lead  time  is  two  periods,  so  production  started  in  period 
t  consumes  resources  in  periods  t  and  t  + 1,  and  can  meet  demand  as  early  as  period  t  -I- 1  : 


INDICES 

t  Time  periods  {t  =  1, 2...T) 

DAIA 

dt  Demand  in  period  t  {di  =0) 

St  Production  resource  available  in  period  t  {st  >  0) 

Ott'  Production  resource  consumption  in  period  t  per  unit  of 

production  started  in  period  t' .  (In  general,  au'  is  not 
restricted  to  be  positive  unless  specified.) 
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production  started  in  period  t  {Xt  —  0,  due  to  lead  time) 
inventory  at  the  end  of  period  t  (Ji  =0,  It  =  0) 
elastic  variable  for  unsatisfied  demand  in  period  t 


mRIABLES 

Xt 

It 

Pt 


FORMULATION 


T 

min 

t=i 

s.t.  Xf-i  —  Jf  +  It-i  Pt  —  dt  1  <  t  ^  T 

®iiXi  <  Si 

ot^t-iXt-i  +  (htXt  ^  St  1  <  t  <  T 
(1t,t—\Xt—\  ^  St 
Xt,/t,Pt>0  vt 


Assuming  that  all  the  demand  is  in  the  last  period,  i.e.,  dt  —  0  <T,  the  inventory 

variables  may  be  eliminated  by  noting  that  I2  =  Xi,  and  It  =  Xt~i  —  It-i  (see  Johnson 
and  Montgomery  [1974,  pp.  197-199]  for  a  detailed  discussion).  Rewriting  P*  as  P,  the 
problem  may  be  reformulated  as 


(yl)  =  min  P 

T-l 

s±  VXt  +  P-d 

(A.1) 

t=l 

(A.2) 

^  1  <  t  <  T 

(AJ) 

^T,T— 1  ^ 

(A.4) 

p  >  0,  >  0  V  t. 

(A.J) 

The  remainder  of  this  section  assumes  A  has  a  finite  optimal  solution  Xf,  1  <  t  <  T 
(throughout  this  document,  a  superscript  on  a  variable  denotes  the  variable  s  optimal  value 
in  the  superscripted  problem). 
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This  simple  problem  offers  a  notationally  straightforward  way  to  demonstrate  a  cas¬ 
cade  on  a  staircase  problem,  eind  it  incorporates  the  additional  richness  of  a  complication 
such  as  elastic  demand. 

1.  Segmented  Approximation 

A  segmented  approximation  is  a  restricted  version  of  a  proximal  cascade  and  it  pro¬ 
vides  a  good  introduction.  Problem  A  is  made  separable  and  approximated  by  removing, 
or  setting  equal  to  zero,  column,  Xr+i  for  some  value  of  r  between  1  and  T  —  1.  The  fol¬ 
lowing  two  maximization  problems  serve  this  pxirpose  by  separating  a  restricted  version  of 
A  into  two  subproblems,  one  optimizing  periods  1  to  r,  and  the  other  optimizing  periods 
T  -f  1  to  T.  The  objective  of  each  is  to  maximize  production,  rather  than  minimize  penalties 
(We  address  the  objective  function  sense  in  greater  detail  shortly). 

Define  the  subproblem  SAl  (with  the  solution  ,  1  ^  i  't,  and  the  solution 
value  )  by 

T 

{SAl )  Z'”'  =  maxy^Xt 

t=i 


s.t.  CLnXi  <  Si 

(SAl.l) 

at^t-iXt-i  -h  (ittXt  ^  St  1  <t  <  T 

iSAl.2) 

Q'r+l,T-^T  —  ^T+1 

(SAl.  3) 

At  >  0  1  <  t  <  r. 

(SAl.  4) 

Similarly,  define  the  subproblem  SA2  (with  the  solution  ,  r  -1- 1  < 

t  <T,  and 

the  solution  value  by 

r-i 

{SA2 )  =  max  5])  At 

t=T+2 

s.t.  ar+2,T+2XT+2  ^  St+2 

(SA2.1) 

Ot.f-iAt-i  -b  ChtXt  ^  St  T  2  <  t  <  T 

(SA2.2) 

CLx^T—lXx—l  ^  Sx 

(SAl  3) 

Xt>0  T  +  l<t<T. 

(SA2.4) 
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Given  these  two  subprobiem  values,  a  bound  on  the  solution  to  A  is  readily  avail¬ 
able.  Using  the  notation  [x]"'’  =  niax[0,x],  the  following  proposition  demonstrates  this 
relationship. 

Proposition  2.1  IfSAl  and  SA2  have  finite  solutions,  <  [d  — 

Proof:  Removing  the  column  Xr+i  (fixing  at  0)  from  A  produces  a  restriction,  but  also 
hints  at  separability: 


Z^  <  min  P 

T  T-1 

s.t.  Xt-HP  =  d 

t=l  t=T+2 

{SAU),...fiSAl.4) 

{SA2.1),...fiSA2.4). 


Solving  for  P,  and  noting  that  P  >  0,  the  above  is  restated  as 


< 


min  d  -  Xt  -  E)Lr+2  1 

s.t.  {SAL  1 ),...,  {SA1.4),  {SA2.1 ),...,  {SA2.4)  \ 


The  non-negative  stipulation  is  an  important  aspect  of  the  problem,  since  SAl  and  SA2  do 
not  restrict  the  variable  sums  to  be  less  than  d.  Because  the  constraint  structure  is  separable, 
the  right  side  of  this  inequality  may  be  rewritten  as 


f  max  Xt  \  _  f  ELr+2  ^ 

V  s.t.  {SA.1.1),...,{SA1.4)  )  s.t.  {SA2.1),...fiSA2.4)  ) 


or: 

[</  _ 

Thus  we  have 

<  [d-Z^“‘  -Z^^Y  . 

□ 

Observe  that  the  combined  solutions  to  Sdi  and&42  are  feasible  to  A  in  the  absence 
of  over-production,  since  restricting  2fr+i  to  zero  makes  A  equivalent  to  SAl  and  SA2  , 
which  are  feasible  by  assumption.  Thus,  a  feasible  approximation  to  A  is  produced  by 
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solving  small  subproblems.  Unfortunately,  the  bound  may  be  weak  when  Xr+i  is  positive 
in  the  optimal  solution  to  the  monolith.  Moreover,  the  method  does  not  work  for  more 
complex  problems.  These  shortcomings  can  be  fixed  by  a  proximal  cascade,  shown  below. 

2.  Proximal  Cascade  Approximation 

The  segmented  approximation  removes  columns  to  produce  separable  subproblems, 
foregoing  any  potential  objective  function  improvement  from  those  columns.  The  proxi¬ 
mal  cascade  partially  redresses  this  disadvantage,  and  we  will  show  that  its  objective  value 
is  boxmded  from  above  by  the  segmented  approximation  just  presented.  This  approach 
also  solves  the  problem  in  piece-wise  fashion,  but  uses  a  sequential  method  that  fixes  col¬ 
umn  levels  from  the  latter  periods  of  preceding  subproblems.  In  turn,  those  fixed  levels 
are  incorporated  into  successor  subproblems,  allowing  an  approximation  by  a  cascade  of 
subproblems.  To  demonstrate,  assume  that  subproblem  SAl  has  been  solved,  and  that  the 
column  levels  of  periods  t  <  r  are  fixed.  Since  Xr-i  is  the  only  colunm  to  directly  in¬ 
fluence  periods  r  and  greater,  the  second  subproblem  may  be  rewritten  to  incorporate  SAl 
using  just  the  level  of  Xt—\.  Towards  that  end,  define  problem  CA2  (with  the  solution 
T  <  f  <  T  -  l)by 

T-l  T-l 

^ca2  ^  +  max  Xt 

t=l  f— T 

5.^.  Cl'f'j-Xj-  ^  Sj-  ^T,T — 1-^T 1 

ot^t-iXt-i  -h  cttXt  ^  St  T  <  t  <T 
(1t,t—iXt—i  ^  Sx 
Xt>0  T<t<T. 


{CA2.1) 

(CA2.2) 

(CA2.3) 

(CA2.4) 


Additionally,  let 

This  value  is  the  proximal  cascade  approximation  of  problem  A.  The  following  proposition 
relates  the  solution  value  of  A  to  its  proximal  and  segmented  approximations: 


15 


Proposition  2.2  IfSAl,  SA2  and  CA2  have  finite  solutions, 


<  [d  -  . 


Proof:  To  show  the  right-hand  inequality,  first  note  that  removing  column  Xr+i  restricts 
CA2 ,  and  thus 

T— 1 

Zca2  >  ^ 

s.t. 


T-1 

+  ^  -^t 

t=r+2 

CLtt^t 

< 

St 

< 

St+1 

UT+2,r+2-^T+2 

< 

St+2 

0‘t,t-\Xt-i 

+attXt 

< 

St 

ott-iXt—i 

< 

St 

Xt 

> 

0 

r— 1 

Y]  Xf  +  max 

Xr 

t=l 

s.t. 

CLtt^t 

< 

^T+l,r-^T 

< 

> 

rsal 


T-1 

-h  max  Xt 

t=T-|-2 

S.t,  <^T+2,r+2-^r+2 


^T+l 

0 


^  St+2 

^  St  T  2  •<.  t  K  T 

Xt>  0  T  +  l<t<T 


2^sa}  _|_ 


Rearranging  terms  yields  the  desired  result: 

_ ^ca2  ^  _  ^sa2 

=  [d  -  <  [d  -  -  Z^"^Y 


This  is  the  right-hand  inequality.  Note  also  that  X^°‘ ,  1  <  t  <  r,  and  X^^ ,  X^^ ,  r  -H  1  < 
t  <T  is  feasible  to  A,  since  SAl  and  CA2  jointly  enforce  the  constraints  of  A. 
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To  show  the  left-hand  inequality,  note  that  setting  Xt-i  =  ^t-i  restricts  problem 
A.  Stated  in  the  form  derived  at  the  beginning  of  the  chapter: 

r-i 

d  —  max 

s.t.  (A.2 ), (A.4),  (SAlTi  (CA2.4 ),  Xr  =  Xf 

d  —  —  max  Xt+  Xt 

s.t.  (SAII),  {SAL4), 
at;t-\Xt-i  +  (HtXt  l<t<r  —  1 

Q/j- J  7- ^X.‘y  —  2  ^  — 1  ^T— 1,T — iX^j- J 

{CA2.J),...,{CA2.4) 

T-l  T-1 

=  d-Y.xf-Y.xf 

t=l  t=T 

[rf_^ca2]+ 

□ 

This  result  shows  that  a  feasible  approximation  to  problem  A  is  obtained  by  proximal 
cascade.  This  approximation  is  no  further  from  the  optimal  solution  value  than  a  segmented 
approximation  of  A,  and  it  is  better  than  the  segmented  approximation  when  production  in 
period  r  -1- 1  is  beneficial.  The  next  section  shows  that  the  proximal  cascade  also  provides 
a  lower  bound  on  the  optimal  objective  value  of  A. 


3.  Lower  Bound  by  Proximal  Cascade 

If  the  assumptions  given  to  this  point  are  supplemented  with  the  non-negativity  of 
ott' ,  a  lower  botmd  on  the  solution  to  A  is  available  from  the  proximal  cascade  subproblems. 
Thus,  for  the  cost  of  solving  SAl  and  CA2 ,  one  obtains  a  feasible  approximation  of  the 
solution  to  A,  as  well  as  an  assessment  of  its  quality. 

To  show  this  result,  a  preliminary  lemma  is  required: 


Lemma  2.3  >0  Vt,f,  Z‘^‘  >  YXf 

t=i 


< 
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Proof; 


=  max 

fXt 

s.t. 

{SAl.l ),...,  {SA1.4) 

>  max 

s.t. 

YXt 

tsAl.l),(SA1.2),(SA1.4) 

®T+l,T-^T  —  ^T+l  ®T+l,T+l-^r+l 

=  EJf.-’- 

t=l 


□ 


The  equality  holds  because  fixing  Xr+i  to  allows  the  remaining  columns  to 
take  their  optimal  values  from  problem  A.  With  this  lemma  (and  the  non-negativity  assump¬ 
tion  of  Ott' ) ,  the  following  proposition  establishes  that  a  lower  bound  derives  from  double 
counting”  the  levels  of  columns  that  are  active  in  both  subproblems.  In  this  case,  Xr  is  the 
“double  counted”  column,  since  it  is  active  in  both  subproblems: 


Proposition  2.4  ifatt'  >  0  Vt,t',  [d  — 


Proof:  Reducing  the  right-hand  side  of  the  period  t  +  I  inequality  from 

St+1  to  St+1  —  o,r+i,TXr  is  a  restriction  of  subproblem  CA2 .  Stipulating  Xr  =  0  further 


restricts  CA2 : 

r— 1 

Xf  + 

t=l 


r-1 

max  Xt 

s.t.  (CA2.J ) 

Or+l.r-^T  +  <^r+l,T+lXT+l  <  Sr+l  —  ar+l,T-^^ 
+  ^,tXt  <  St 
Xr=0 

(CA2.3),(CA2J) 


=  Y 

t=l  t=T+l 

S.t.  ar+l,r+l-^T+l  —  St+1  ~  Qt+I.t-^t 

at,t-iXt-i  +  <h,tXt  <  St  T  -\-2  <t  <T 
{CA2.Z),{CA2.A) 


=  Y^f 

t=i 


-H 


E 
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The  last  equality  holds  because  fixing  Xr  to  X:^  allows  columns  indexed  by  periods  r  +  1 
to  period  T  to  take  their  optimal  values  from  problem  A.  Thus 

r— 1  T—l 

^ca2  ^  ^  Xf  +X  f  A 

t=l  t=T+l 

T-1 

=  Z^‘  +  Y1 

Combining  this  with  lemma  II.3,  we  have 

T-l 

Zca2  j^Xf  >^X^, 

t=\ 

or 

T-l 

_Zca2  _xf  <  -  ^  X^. 

t=l 

Thus 

□ 

The  results  of  this  section  use  a  very  simple  problem,  but  provide  the  groundwork  for 
the  remaining  research.  However,  these  results  must  be  generalized  to  multiple  commodities 
and  other  staircase  problems  before  they  become  useful  for  the  motivating  problems  of 
this  dissertation.  During  the  course  of  this  development,  we  show  that  only  the  proximal 
cascade  upper  bound  holds  in  a  more  general  setting.  Thus,  a  revised  lower  bound  must  be 
developed.  That  development,  as  well  as  the  generalization  of  the  proximal  cascade,  is  the 
subject  of  the  remainder  of  the  chapter. 

B.  MULTI-COMMODITY  ELASTIC-DEMAND  STAIRCASE  LP 

Although  the  single-commodity  elastic-demand  staircase  problem  offers  interesting 
results  with  respect  to  a  proximal  cascade,  its  usefulness  is  limited  by  the  assumption  of  a 
single-commodity.  These  next  two  sections  generalize  proximal  cascade  results,  first  to  the 
multi-commodity  problem,  then  to  more  general  staircase  models. 


[d-Z‘^‘‘^  -XfY  ^ 


T-l 


t=l 
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1. 


Inapplicability  of  Segmented  Bounds 


Unlike  its  single-commodity  coimterpart,  the  multi-commodity  elastic-demand  stair¬ 
case  problem  does  not  easily  lend  itself  to  segmented  solution.  Consider  the  following 
two-period  problem  with  two  commodities  referenced  by  X  and  Y: 


{A1 )  =  min  +Pa’  +Py 

s.t  Xi  +X2  +Px  =  10 

-hFi  +I2  +Py  =  10 

2X1  +Yi  <  6 

2X1  AYi  -\-2X2  +^2  ^  12 

-t-3X^2  'YY2  ^  6 

Xi.  Yi,  X2,  Y2,  Px,  Py  >  0, 


which  has  solution 


=  9,  X^^  =  1,  n-"'  =  4,  Xf  =  0,  Y^^^  =  6,  Pf  =  9,  Pf  =  0. 


Also  consider  the  subproblem 


{A2)  =  max  Xi  -f-li  +X2  +Y2 

s.t  2X1  -hri  <  6 

2X1  -l-Vi  -I-2X2  +^2  ^  12 

+3X2  +1^  ^  0 

Xi,  Fi,  X2,  F2.  >  0, 

which  has  solution 


=  12,  Xf  =  0,  Xf  =  0,  =  6,  F/2  =  6. 


Direct  extension  of  the  segmented  approach  to  the  multi-commodity  case  requires 
the  equivalence  of  2^'^^and  [dx  “I"  .  However,  this  does  not  hold  here,  since 

=  9  >  8  =  [dx  +  -  Z^^]^  . 


The  difficulty  springs  from  overproducing  the  “easy”  commodity  F  and  using  it 
to  offset  imder  production  of  X,  which  consumes  more  resources.  While  it  is  possible 
to  redress  this  shortcoming  by  retaining  the  original  form  of  the  demand  rows,  doing  so 
eliminates  the  ability  to  show  that  the  segmented  problem  is  an  upper  boimd  to  the  proximal 
cascade  solution.  Consequently,  the  segmented  approximation  is  not  considered  further. 
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2.  The  Multi-Commodity  Proximal  Cascade 

Despite  the  inability  to  use  the  segmented  solution  as  a  boimd  on  the  proximal  cas¬ 
cade,  a  proximal  cascade  provides  an  upper  bound  on  the  problem  of  interest,  namely  a 
multi-commodity  elastic-demand  staircase  problem.  Below  is  the  general  formulation  of 
this  problem,  where  each  commodity  has  an  allowable  production  time  window  of  consec¬ 
utive  periods.  This  problem  will  serve  as  the  monolith  for  the  remainder  of  the  chapter: 


INDICES  AND  INDEX  SETS 
i  €  I  Commodities 
t,t’  €T  Time  periods 

t  eTi  Allowable  time  periods  for  initiating  production  of  i 

i!  G  TSt  Periods  of  initiated  production  that  consume  resources  in  period  t 

DAIA 

di  Demand  for  commodity  i,  due  when  production  begun  in  the  last 

period  of  Ti  is  complete 

hi  Penalty  per  unit  of  not  delivering  commodity  i 

St  Production  resources  available  at  time  t  {st  >  0) 

Resource  consumption  in  period  t  per  unit  of  i  begun  in  period  t' 

Thus,  ant'  =  0  unless  t'  6  TSt 

(in  general,  aiu'  is  not  restricted  to  be  positive  unless  specified) 
mRIABLES 

Xit  Production  of  i  begun  in  period  t 

Pi  Elastic  variable  for  unsatisfied  demand  of  commodity  i 

FORMULATION 

(B)  =  min  ^  hiPi 

s.t.  E  Xit  +  Pi  =  di  yi  el  (ai)  {B.l ) 

t^T- 

E*  E  aitt'Xit'<St  ^teT  iPt)  {B.2) 

iei  t'eTinTSt 

Xit,Pi>0  ^iel  ,teT  (B.3) 

Assume  B  has  a  finite  optimal  solution,  Xjf,  P^^ 

Now  consider  N  overlapping  subsets  of  contiguous  time  periods  within  set  T  that 
suggest  subproblems  (Figures  1  and  2): 
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n=1 

- n-2 

- n=3 


♦ 


Time 


n=N 


Figure  1.  Sequence  of  subproblems  forming  a  proximal  cascade.  The  subproblems  contain  rows  and  columns  indexed  by 
overlapping  subsets  of  active  time  periods. 


Define  the  following: 


firstp  ”  First  time  period  of  subproblem  n 
lastp  "  Last  time  period  of  subproblem  n 

caswid  max„  [lastp —  firstp'^]  +  1,  the  proximal  cascade  subproblem  width 
rC”  {t  €  T  :  firstp'^  <t  <  lastp'^} ,  Ae  active  index  set  of  subproblem  n 
m  maxt  [|riSt|]  —  1,  the  maximum  resource  utilization  (staircase)  overlap 
V  lastp^  —  firstp'^^^  +  1,  the  number  of  time  periods  overlapping  each 

subproblem  (cascade  overlap,  assumed  to  be  constant) 

7’C’n  {t  eT  :  firstp'^  <t  <  firstp^'^^}  for  n  <  iV 
{t  e  T  : firstp'^  ,  forn  =  iV 
the  periods  of  TC  ”,  up  to ,  but  not  including . 

NC  n  =  {1, N} ,  the  set  of  subproblems  forming  the  proximal  cascade 


Note  that  there  are  two  overlap  parameters  defined.  Parameter  m  is  the  staircase 
overlap,  and  is  a  characteristic  of  the  LP  formulation.  In  contrast,  v  is  the  cascade  over¬ 
lap,  and  is  a  proximal  cascade  parameter.  The  next  chapter  discusses  the  ramifications  of 
choosing  v.  However,  v  should  be  at  least  as  large  as  m  in  to  promote  cascade  feasibility. 

The  above  definitions  permit  specification  of  N  proximal  cascade  subproblems, 
CAS^.  Under  the  assiunption  that  a  finite  optimal  solution  exists,  let  X^,  Ff  solve 
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Figure  2.  A  single  proximal  cascade  subproblem  optimizes  rows  and  columns  indexed  by  the  active  set  {t  ).  Thus 

it  re-optimizes  rows  and  columns  indexed  by  time  periods  active  in  the  previous  subproblem,  t  ^PlTU”.  Rows 

of  future  time  periods  are  relaxed,  future  columns  are  fixed  at  level  0.  Columns  of  subproblem  n  that  are  not  active  in 
subproblem  n  -f  1  (indexed  by  t  ^TF^)  are  fixed  at  the  end  of  n. 


(CAS^)  =  imnY^hiPi 

iel 

s.t.  ^2  +  Pi  =  di—  ^2 .  ^2  Vi  €  /  (CAS^.l) 

teTiOTC^  v/<n  teTiflTF"' 

aut'Xit'  <  y^  vt  €  tcp 

i£i  t'eT<nrStnTC"  n'<n  iei  t'eTinTStnTF^' 

(CAS^.2) 

Xit,  Pi>0  Vi  €  /,  t  €  Ti  n  rC".  (CAS^.3) 


The  proximal  cascade  heuristic  proceeds  as  follows  (a  detailed  pseudocode  is  given 
in  Chapter  III): 


For  each  n  eNC  { 

Define  and  solve  subproblem  C45”  given  above 
Fix  the  value  of  X,”  Wi  e  I,  t  eTF'^ 

>  .  -A. 

Output  proximEil  cascade  solution:  X^^  E:  I,  t  n  eNC,  with  value  Z  . 


Each  subproblem  n  activates  all  penalty  columns  and  demand  rows,  but  only  the  Xu 
columns  for  t  €  TC”  .  However,  the  subproblems  have  successively  more  fixed  XJ^  values 
from  previous  subproblems.  Thus,  the  demands  of  the  last  subproblem  N  are  reduced  by 
the  solution  values  from  TF^  through  TF^~^.  Similarly,  staircase  row  right-hand-sides  are 
reduced  by  fixed  terms  from  previous  subproblems. 
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Single  Commodity  Subproblem 


Multi-Commodity  Subprobiem 


TC 


TC 


Figure  3.  Unlike  its  single  commodity  counterpart,  a  multi-commodity  proximal  cascade  subproblem  excludes  both 
columns  and  rows  indexed  by  future  time  periods.  These  rows  are  required  only  for  the  segmented  results  of  the  previous 
section,  and  may  cause  infeasibility  in  more  general  problems. 


In  addition  to  multiple  commodities  and  generalized  notation ,  CAS  ”  differs  slightly 
from  the  single-commodity  subproblem  CA2.  Figure  3  illustrates  that  a  subproblem  CAS'^ 
ending  with  period  t  activates  the  staircase  rows  only  up  to  period  t,  while  the  single¬ 
commodity  method  activates  all  remaining  rows  associated  with  period  t  columns.  Whereas 
these  additional  rows  are  useful  when  comparing  to  the  segmented  solution,  they  are  not  re¬ 
quired  in  the  general  case,  and  may  cause  infeasibility  or  reduce  solution  quality  of  the 
cascade.  For  example,  consider  a  model  where  ant'  is  negative  for  the  latter  columns  of  a 
staircase  row.  Activating  the  row  without  those  latter  columns  may  force  other  associated 
columns  to  unnecessarily  low  values  in  order  to  maintain  feasibility.  Thus,  any  staircase 
row  whose  associated  columns  are  not  either  active  or  fixed  is  not  activated  in  CAS^',  each 
subproblem  ends  with  the  staircase  rows  indexed  by  the  last  period  of  TC”. 

The  following  theorem  shows  that  the  solution  value  of  a  cascade’s  final  subproblem 
{Z^)  provides  an  upper  bound  on  B. 


24 


Theorem  2.5 


<  Z^. 


Proof: 


=  min 

Y^hiPi 

iei 

s.t. 

{B.l),{B.2),iB.3) 

<  min 

YhiPi 

iei 

s.t. 

{B.1),{B.2),{B.3) 

Xu  =  X^t  Vn  <  iV,t  G  Ti  n  TF' 

=  min 

s,t. 

(C45^.1),  {CAS^.2),  {CAS^.Z), 

= 

The  inequality  holds  since  fixing  a  subset  of  Xu  restricts  the  original  problem. 

□ 

Although  similar  to  the  proof  given  for  the  single-commodity  problem,  this  proof 
restricts  all  column  levels  for  t  <firstp^  to  their  associated  subproblem’s  value.  However, 
fixing  only  the  columns  of  the  overlapping  staircase  periods  (firstp^  -  m  <  t  -^rstp^, 
Vn  Give )  gives  the  same  result,  since  that  restriction  results  in  separable  problems,  namely 
CAS^,^n  Give. 

The  above  proof  shows  that  the  proximal  cascade  solution  provides  an  upper  bound 
on  Z^.  Additionally,  the  solution  given  by  the  cascade  result  (X^ ,  Vn  G  iV,  i  G  /,  t  eTF^) 
is  feasible  to  B,  since  the  rows  of  B  are  enforced  by  the  rows  of  CAS^  Vn  GiVe . 

C.  PROXIMAL  CASCADES  WITH  BASIC  STAIRCASE  LPs 

A  proximal  cascade  is  applicable  to  basic  staircase  models.  This  section  extends  the 
upper  and  lower  proximal  cascade  bounds  (developed  for  the  single-commodity  demand 
problem)  to  a  simple  staircase  problem. 

Consider  problem  S  below.  Parameter  ht  is  defined  as  the  objective  cost  coefficient; 
otherwise  the  notation  is  the  same  as  in  problem  B. 
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{S)  =  max.'^htXt 

t^T 

S.t.  ^  ^  OLtt'Xt!  ^  St  '^t  gT  (S.l) 

t'eTSt 

Xt>0  MteT  (5.2) 

Similarly  (using  the  same  notation  as  in  C45"),  consider  the  cascade  subproblem  SCAS^: 

(SCAS^)  =  E  E  "h  IHQiX  ^  ^  hiXf 

n^<nt£TF^'  t€rC^ 

s.t.  <^t'Xt'<  St-Y,  Y  (SCASr.l) 

t'eTStOTC^  n'<n  t^eTStCiTF'^' 

Xt>0  Vt  €  rc".  iSCASr.2) 


In  addition  to  the  formulation  differences,  SCAS'^  differs  from  C45"  by  a  constant 
term  in  the  objective  function.  When  demand  is  reduced  by  previous  subproblems,  each 
C45"  optimal  objective  value  becomes  progressively  lower.  The  basic  staircase  model 
SCAS^  on  the  other  hand,  must  explicitly  incorporate  a  contribution  from  previous  sub¬ 
problems.  The  solutions  from  these  previous  subproblems  n'  <  n  are  summed  only  over 
the  set  7F"'  in  order  to  avoid  “double  coimting”  columns  indexed  by  periods  inside  the 
cascade  overlap. 

Let  Xf  'it  eT  and  Xt  it  €.TC^  solve  S  and  5C45”,  respectively  (as  before,  as¬ 
sume  5C45”  has  a  finite  optimal  solution  for  all  n  eNC).  The  following  theorem  shows 
that  the  proximal  cascade  solution  value  bounds  the  monolith  solution  value  from  below. 
Additionally,  if  atv  >  0  a  proximal  cascade  also  provides  an  upper  bound  to  the 
monolith  solution  value.  The  upper  bound  is  the  sum  of  non-constant  objective  terms  from 
all  periods  in  all  subproblems  (thus  it  includes  cascade  overlap  double  counting).  The  lower 
bound  is  the  sum  of  objective  terms  from  the  non-overlapping  periods  in  all  subprob¬ 
lems. 
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Theorem  2.6 


>  Z^,  andifatt'  >  0  ^ 

n£NC  teTC” 

Proof:  For  the  first  inequality, 


Z^  —  max  Y1 
t€T 

s.t.  {S.1),{S.2) 

>  max  ^  htXt  (‘S'-P-l) 

t^T 

s.t.  {S.l),{S.2) 

Xt  =  X^  ^n<  N,t  €TF^ 

=  E  EteT^t^r'+  E  htXt  {SP.2) 

n'<N  t&TC^ 

S.t.  {SCAS^.1),{SCAS^.2) 

=  Z^. 


SPl  is  a  restriction  of  the  original  problem  because  all  of  the  solution  values  are 
fixed  except  for  the  last  subproblem’s  values.  As  with  CAS'^,  SCAS^  is  feasible  to  the 
monolith  since  the  rows  of  the  subproblems  jointly  enforce  the  rows  S. 

To  show  the  second  inequality,  begin  with  the  sum  of  the  non-constant  objective 
terms  from  the  proximal  cascade  subproblems: 


neNC  t&TC”-  n&NC 


E  htXt 

t€TC^ 

S.t.  {SCAS^.l),{SCAS'^.2) 


(SL.1) 


>  max 

nSiVC 


E  htXt 

t€TC”^ 

S.t.  (SCAS^.l),  {SCAS^.2) 
Xt  =  0  Vt  G  TC”  n  TC”-^ 


iSL.2) 


max 

neJVC 


E  htXt 

teTC"\TC"-i 

s.t.  E  <^tt'Xt>  <StytE  TC^\TC^-^ 

t'  €TStn(TC"\rC"- 1 ) 

Xt  >  0  te  TC^\TC^-^  J 

(SL.3) 
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>  ^  max 

n£NC 


E  htXt 
terc^VTC"-! 

S.t.  Ortt'X^I 

t'eT5tnTC"-i 

+  E  ^t'Xf  <st\/t^  TC^\TCr-^ 

t'€r5tn(TC"\TC"-i) 

=  vt  €ra'*nTa"+^ 

Xt  >  0  Vf  e  TC”'\TC^~'^ 


=  max  E  htXt 
teT 

s.t.  E  <  5t  vt  e  T 

t'eTS 

Xt>0  ^t€T 


{SL.4) 

{SL.5) 


=  Z^. 

SL.2  is  a  restriction  of  51. 1  since  all  of  the  columns  indexed  by  periods  of  the  lead¬ 
ing  subproblem  overlaps  are  set  to  0.  This  is  a  nontrivial  restriction  if  the  cascade  overlap  is 
large.  SL.3  is  a  restatement  of  5i.2,  since  no  resources  are  used  by  columns  set  to  0,  which 
include  any  columns  that  might  use  resources  in  the  remaining  active  periods.  Additionally, 
the  row  domain  of  the  staircase  constraint  from  SL.3  may  now  exclude  the  overlap  rows, 
since  they  contain  only  constants.  These  are  the  only  rows  that  could  include  fixed  terms 
from  previous  subproblems,  so  that  term  may  be  dropped.  SL.  4  further  restricts  the  prob¬ 
lem  by  including  resource  consumption  of  X^  from  columns  of  the  preceding  subproblem  s 
staircase  overlap.  SL.4  also  restricts  the  problem  by  fixing  (to  Xf')  all  the  columns  that  ap¬ 
pear  in  the  succeeding  subproblem’s  rows.  Finally,  SL.5  reflects  that  a  subproblem  whose 
overlapping  staircase  values  are  set  to  the  optimal  solution  (on  either  side)  must  produce 
optimal  values  when  solved. 

□ 

This  result  provides  an  optimistic  bound  (upper  for  a  maximization  problem)  and  a 
feasible  bound  (lower  for  a  maximization)  on  the  monolith,  obtained  for  the  computational 
cost  of  solving  the  proximal  cascade.  However,  the  usefulness  of  the  optimistic  bound  is  re¬ 
duced  by  the  fact  that  it  tends  to  be  tighter  vrith  a  minimal  cascade  overlap  {v  =  m),  while 
the  feasible  bound  tends  to  be  tighter  with  a  large  cascade  overlap.  Additionally,  the  opti¬ 
mistic  bound  requires  non-negativity  of  the  technological  coefficients,  which  also  restricts 
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its  applicability.  The  next  section  describes  an  optimistic  bound  with  wide  applicability — 
one  that  can  be  used  on  any  staircase  problem. 


D.  LAGRANGIAN  CASCADE  LOWER  BOUND 


1.  Development 

Lagrangian  relaxation  has  long  been  used  to  bound  linear  and  integer  programs  by 
solving  partitioned  subproblems.  By  partitioning  subproblems  along  temporal  lines,  each 
can  be  solved  separately  by  (Lagrangian)  relaxing  rows  that  link  active  periods  from  differ¬ 
ent  subproblems.  The  structure  of  a  staircase  problem  facilitates  this,  since  most  rows  link 
only  a  few  proximal  time  periods. 

Multi-commodity  elastic-demand  staircase  problems  complicate  relaxation  along 
temporal  lines  because  the  demand  rows  link  many  time  periods.  However,  the  rows  are 
elastic,  which  establishes  bounds  on  the  corresponding  dual  variables.  Consequently,  ap¬ 
propriate  penalties  in  the  relaxed  problem  stay  within  those  limits. 

The  biggest  advantage  of  using  Lagrangian  relaxation  in  a  cascade  is  the  availabil¬ 
ity  of  dual  information  from  the  associated  proximal  cascade.  One  of  the  weaknesses  of 
Lagrangian  relaxation  is  the  computational  effort  required  for  the  multiplier  search.  That 
search  is  circumvented  by  the  availability  of  the  proximal  cascade’s  dual  variables. 

Consider  once  again  problem  B  with  finite  optimal  solution  ,  Pf  Vz,  t : 


min  Y]  htPi 

i€l 

(“i) 

(B.l) 

s.t.  ^  Xit  -1-  Pi  =  di 

Wi  el 

t€Ti 

(M 

(B.2) 

^  St 

\/teT 

iei  t'eTityrSt 

(B.3) 

XiuPi>0  ^iel  ,t€T. 

Dual  variables  are  denoted  ctj,  Pf. 

Consider  a  partition  of  T  into  L  subproblems  (Figures  4  and  5): 


29 


il=1 


A=2 


Time 


Figure  4.  A  Lagrangian  cascade  partitions  the  rows  and  columns  of  a  monolith  into  many  Lagrangian  subproblems  of 
contiguous  time  periods.  Overlapping  rows  are  Lagrange-relaxed. 


The  following  notation  and  Figure  5  are  also  useful: 
firstl  ^  The  first  time  period  in  subproblem  t 

lastl  ^  The  last  time  period  in  subproblem  £ 

Iwid  max«  [lastl ^  -firstl^]  -I- 1,  the  Lagrangian  cascade  subproblem  width 

TR^  {t:  firstl  ^  <t<  {firstl  ^  +  m)}J^l.  The  Lagrange-relaxed  set, 

Ae  set  of  early  periods  of  subproblem  £  where  staircase 
rows  overlap  subproblem  £—1 

TL^  {t:  max(t  gTR^)  <t<  lastl  The  enforced  set,  the  set  of  later  periods 

of  £  where  staircase  rows  do  not  overlap  subproblem  £  —  1 
TRL  ^  TR^UTL^  The  active  index  set  of  subproblem  £ 

TO^  {t:  firstl  firstl  The  extended  set,  the  set  of  active  periods 

in  subproblem  £-1  where  staircase  rows  of  subproblem  £  overlap 
TRL  ^  U  TO  ^  The  extended-active  set 

IL^  {i :  Ti  n  m  V  0, 7’i  TRL  =  0}  Partition  of  /  into  subproblems 

This  scheme  places  i  into  the  last  subproblem  in  i’s  production  window 


CL  { 1 , . . . ,  L} ,  The  set  of  Lagrangian  cascade  subproblems 


The  active  index  sets  {TRL  may  be  chosen  to  closely  correspond  to  the  proximal 
cascade  active  sets,  TC  or  can  be  intentionally  offset  from  those  sets  in  order  to  improve 
the  latter’s  dual  variables.  These  strategies  are  discussed  in  the  next  chapter.  Given  these 
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Figure  5.  A  single  Lagrangian  cascade  subproblem  includes  columns  indexed  by  t  &TRL  ^  (the  active  set  ),  and  rows 
indexed  by  t  eTL^.  Other  rows  are  relaxed,  and  a  Lagrangian  penalty  is  applied  to  the  objective  function  coefficients  of 
the  associated  active  columns  (referred  to  as  Lagrange-relaxed  rows).  An  extension  tightens  the  Lagrangian  cascade  bound 
by  activating  “extended  constraint”  rows  indexed  by  t  qTR‘  (the  Lagrange-relaxed  set).  These  rows  use  “duplicate” 
columns  indexed  by  f  €70  ^  in  order  to  preserve  the  relaxation. 


sets,  define  the  Lagrangian  cascade  subproblem  LC : 
=  min  Yh 


{LC.l ) 


+  Yoci(di  -  Y^it  -  p) 
i€l  \  t&Ti  J 


+  Y  Pt\  —  Y  13 

te{\JeTR‘)  \  iat'^TiOTSt 

s.t.  Y  13  ^  St 

t'^TiOTSt 

Xit,Pi>o  'iiei  ,teT. 


VteU^TL^  (IC2) 
{LC.3 ) 


The  objective  {LC.l )  seeks  to  minimize  the  sum  of  unsatisfied  demand,  plus  Lagrangian 
penalties  either  associated  with  demand  rows,  or  the  staircase  rows  of  the  relaxed  set.  The 
remaining  structural  constraints  include  only  the  staircase  rows  of  the  enforced  set. 

Because  all  of  the  linking  rows  between  subproblems  are  Lagrange-relaxed,  LC  de¬ 
composes  into  L  subproblems  with  =  Ye  Note  ai  is  bounded  above  by  hi,  and 
thus  the  Pi  term  is  not  favorable,  and  will  remain  at  0.  It  is  left  in  the  formulation  for  com¬ 
pleteness.  The  subproblems  LC^  are  defined  as 
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—  min  Yh  Pii^i  —  Q:*)  +  S  (LC^.l) 

i&IL^  ielL^ 

—  Y  S  o^iXit  +  Y 

i€l  t&TRL‘  teTR^ 

—  ^  ^  Y  Pt^tt'^it' 

i€l  t&TR^liTR‘+'^  t'&Tir\TStra'RL‘- 

s.t.  Y  S  aitt'Xit'<St  \/teTL^  {LC^.2) 

ielt'eTiDTSt  ,  .  , 

Xit,  Pi  >  0  Vi  e  JL^  t  €  TRL^.  (LC^.S) 

Relaxing  the  problem  in  this  manner  allows  the  tractable  computation  of  a  lower  bound  on 
Z^.  By  the  theorem  of  weak  Lagrangian  duality  [Parker  and  Rardin,  1988,  p.  206], 

z^  =  Y^Z^<  Z^. 

I 

A  Lagrangian  cascade  proceeds  as  follows  (a  detailed  pseudocode  is  given  in  Chap¬ 
ter  III); 

ForeachfeCZ  { 

Define  and  solve  subproblem  LC^  given  above 
Record  the  value  of  Z^ 

Output  the  Lagrangian  cascade  solution  value:  Yt  ■ 

As  stated  earlier,  the  quality  of  this  bound  depends  in  large  measure  on  the  quality  of 
the  dual  variables.  These  variables,  in  turn,  depend  on  the  quality  of  the  proximal  cascade 
solution.  As  the  proximal  cascade  solution  tends  toward  the  optimal  monolith  solution, 
the  associated  duals  will  tend  toward  the  optimal  monolith  dual  solution.  Hence,  there  is 
strong  incentive  for  making  the  proximal  cascade  solution  as  close  to  the  monolith  solution 
as  possible. 


2.  Improving  the  Lagrangian  Cascade  Bound 

Although  optimal  Lagrange  multipliers  ensure  a  tight  lower  bound  on  the  problem 
under  consideration,  small  deviations  in  multiplier  accuracy  may  produce  an  unacceptable, 
or  even  unbounded  result.  This  may  be  avoided  by  bounding  the  feasible  region  of  the  La¬ 
grangian  cascade  subproblems.  This  section  addresses  two  bounding  techmques,  sxtcndsd 
constraints  and  demand  bounding. 
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a.  Extended  Constraints 

A  Lagrangian  relaxation  cannot  be  unbounded  if  all  its  variables  are  bounded. 
Using  a  Lagrangian  cascade,  we  show  here  that  a  simple  and  effective  bound  on  vari¬ 
ables  is  generated  by  extending  the  staircase  constraint  enforcement  into  each  subproblem  s 
Lagrange-relaxed  set,  TR  L  However,  to  avoid  a  problem  restriction,  associated  columns  in¬ 
dexed  by  periods  of  the  overlap  set  (TO  are  not  identical  to  their  monolith  counterparts. 
These  columns  are  “duplicates,”  and  are  denoted  Xa.  This  method  of  generating  dupli¬ 
cate  columns  for  the  purpose  of  bounding  variables  inside  the  active  index  set  is  described 
below. 

Consider  problem  B,  which  is  identical  to  B,  but  with  constraint  blocks  B  A 
and  B.5  added: 


= 

min 

EhiPi 

s.t. 

i£l 

^  Xu  +  Pi  —  di 

'ii£  I 

(B.I) 

tGTi 

O^itt'Xu'  <  St 

iel  t'^TiOTSt 

Xu,Pi>0  ^iel  ,tGT 

^teT 

(B.2) 

(B.2) 

^  0-itt'Xu'  +  ^  O-itt'Xit'  <  St 

t'eTinTStnTO‘  ie-f  t'eTiHTStnTR^ 

Xu  >0  veeCL,  iel  TD^TR^. 

yteiJeTR^ 

(B.4) 

(B.S) 

BA  duplicates  all  staircase  rows  for  all  of  the  relaxed  sets  However, 

within  each  subproblem,  only  the  columns  indexed  by  t  eTRL^  correspond  to  monolith 
columns.  Columns  indexed  by  t  are  duplicated;  duplicates  do  not  appear  in  other 

subproblems.  Because  of  duplication,  these  rows  cannot  restrict  the  solution  to  B. 


Theorem  2.7 

>  Z^. 

Proof:  Let  Xu  =  X^  \/i,t  €  {jJR^-  Since  satisfies  B.2  from  the  original 

problem,  Xu  must  satisfy  (BA),  which  means  Xu  is  feasible  to  B.  Thus,  Z^  can  be  no 
worse  than  Z^. 
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In  fact,  ,  since  the  duplicate  columns  do  not  contribute  to  the  objec¬ 

tive,  nor  do  they  allow  the  original  columns  to  further  contribute  to  the  objective.  However, 
this  is  not  central  to  the  overall  result,  which  is  to  show  that  a  Lagrangian  relaxation  of  B 
is  still  a  relaxation  of  B. 

Since  any  Lagrangian  relaxation  of  B  provides  a  lower  bound  for  B,  one 
that  relaxes  B.l  Vi,  and  B.2  Vt  G  €  Provides  such  a  bound.  Defining  the  solution 
value  of  this  relaxation  to  be  Z^^,  we  have 

Z^  >Z^  >  Z^. 

The  solution  to  the  relaxation  of  .B  offers  the  benefit  of  bounding  all  variables 
in  the  Lagrangian  cascade.  Since  its  implementation  only  involves  generating  duplicate 
variables  as  the  Lagrangian  cascade  progresses,  this  strategy  may  provide  significant  benefit 
with  minimal  computational  effort. 

The  extended  constraints  result  has  wide  applicability  to  Lagrangian  relax¬ 
ation.  Consider  the  following  staircase  problem: 


Z*  =  max  (^xi  +C2X2  +033:3 

s.t.  Ai\X\  <  i>\ 

A2\Xi  +^222:2  <  ^2 

■^322:2  +.^332:3  ^  ^3 
Xi,  X2,  X3  >  0. 

This  problem  can  be  separated  into  two  subproblems  by  relaxing  the  second  constraint: 

Z^^  =  max  cfxi  +C2'x2  +0^2:3  +  ^2  (^2  ~ -^212:1  ~ -^222:2) 

s.t.  AiiXi  <  h 

Az2^2  +-^332:3  —  ^3 

Xi,  X2,  X3  >  0. 

Alternatively,  we  can  form  separable  subproblems  by  duplicating  xi  and  using  the  extended 
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constraints  Lagrangian  relaxation: 


^ELR  _ 


max  cfxi 

+C^X2 

+032:3 

+ 

M2 

s.t.  AiiXi 

< 

h 

A21X1 

-\-A22X2 

< 

62 

A32X2 

-I-A33X3 

< 

63 

Xi, 

Xu 

X2, 

2:3 

> 

0. 

•^21^1  ~  -^222:2) 


Both  and  provide  upper  bounds  for  Z*,  but  Z^^^  provides  a  tighter  bound  by 
Theorem  II. 7: 

Z*  <  Z^^^  <  Z^^. 

To  illustrate  the  benefits  of  extended  constraints,  consider  the  following  stair¬ 


case  LP: 

max  2X1  -t-4J^2  "^Xz 
s.t.  Xi  <2 

Xi  -\-X2  ^  3  {02) 

X2  +X3  <  4 

Xi,  X2,  X3  >  0. 

A  solution  to  this  problem  is:  X^  =3,  ^3*  =  1,  with  value  13.  Lagrangian  relaxation  of 
the  second  row  results  in  the  following  for  /?2  >  0^ 

max  2X1  +4X2  +X3  +  ^2(3  ~ -^1  ~ -^2) 

s.t.  Xi  <2 

X2  +X3  <  4 

Xi,  X2,  X3  >  0. 


When  P2  =  the  above  may  be  rewritten  as 

3  -I-  max  Xi  -f-  max  3X2  -I-X3 

s.t.  Xi  <  2  s.t.  X2  +X3  <  4 

Xi  >  0  X2,  X3  >  0. 

This  has  a  solution  Xi  =  2,  X2  =  4,  with  value  17,  which  is  an  optimistic  bound  on  the 
first  problem,  Z*  =  13.  However,  the  bound  may  be  tightened  by  duplicating  Xi  with  Xi, 
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and  incorporating  the  method  of  extended  constraints: 

3  +  max  Xi  +  max  ^  3X2 

s.t.  Xi  <  2  s.t.  Xi  +X2  <  3 

.  Xi  >  0  ^  ^2  +^3  <  4 

Xi  X2,  Xs  >  0. 

This  has  solution  Xi  =  2,  X2  =  3,  with  value  14,  resulting  in  a  tighter  bound  than  17. 

b.  Demand  Bounding 

In  addition  to  the  method  of  extended  constraints  described  above,  the  qual¬ 
ity  of  the  Lagrangian  cascade  solution  may  be  improved  by  assuring  that  each  subproblem 
satisfies  no  more  demand  than  the  total  required  by  a  Lagrange-relaxed  demand  row. 

Consider  problem  B,  which  is  identical  to  B,  but  with  additional  constraint 

stipulated  by  B.4  : 

(B)  =  min  ^  hiPi 

s.t.  ZXit+  Pi^di  'iiel  {B.l) 

E  Xit<di  (B.4) 

t^TinTKLe 

(B.2),(B.3). 

Note  that  B.4  is  redimdant  given  B.l  in  this  formulation,  but  ceases  to  be  so  when  B.l  is 
relaxed.  Hence,  B  and  B  are  equivalent,  but  the  relaxation  of  B  provides  a  better  lower 

bound  on  . 

Demand  bounding  also  applies  to  Lagrangian  relaxations  of  more  general 
mathematical  programs.  Given  that  all  elements  of  A21  and  A22  are  non-negative,  consider 
how  demand  bounding  can  tighten  the  solution  bound  of  a  simple  staircase  problem. 


max  cfxi 

+C^X2 

+0^X3 

s.t.  AiiXi 

< 

A21X1 

-{-A22X2 

< 

A32X2 

+A33X3 

< 

Xi, 

X2, 

X3 

> 
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max 

T 

CiXi 

+C^X2 

+Ci’x3 

+ 

P2  (^2  ~  A21XX  —  A22X2) 

s.t. 

AnXi 

< 

h 

A2iX\ 

< 

b2 

A22X2 

< 

b2 

A32X2 

-1-^433X3 

< 

bz 

Xi, 

X2, 

xz 

> 

0 

max 

T 

cixi 

+0^X2 

+clxz 

+ 

P2  {b2  -  A21X1  -  ^222:2) 

s,t. 

Aiixi 

< 

bi 

A32X2 

-f  A.33X3 

< 

bz 

Xi, 

X2, 

Xz 

> 

0. 

Z*  is  bounded  above  by  the  Lagrangian  relaxation  with  demand  bounding  (middle),  which 
is  bounded  above  by  the  un-enhanced  Lagrangian  relaxation  (bottom). 

E.  SUMMARY 

This  chapter  develops  bounds  for  staircase  problems  using  proximal  and  Lagrangian 
cascades.  A  proximal  cascade  provides  an  upper  bound  (if  a  minimization  problem)  by 
solving  a  sequence  of  subproblems.  Under  the  restricted  condition  of  non-negativity  of  the 
constraint  coefficients,  modifying  the  proximal  cascade  solution  value  also  provides  a  lower 
boimd  on  the  monolith  solution  value. 

A  Lagrangian  cascade  provides  an  optimistic  bound  for  the  staircase  problems  de¬ 
scribed  in  this  chapter.  Lagrangian  cascades  avoid  traditional  multiplier  searches  by  using 
dual  information  from  the  proximal!  cascade.  Together,  proximal  and  Lagrangian  cascades 
offer  an  alternative  to  solving  a  linear  program  monolith. 
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III.  PROXIMAL  AND  LAGRANGIAN  CASCADE  HEURISTICS 


This  chapter  serves  as  a  transition  between  theory  and  implementation  of  the  proxi¬ 
mal  and  Lagrangian  cascades.  Each  cascade  type  is  dealt  with  separately,  beginnmg  with  a 
description  and  pseudocode.  A  discussion  of  cascade  parameter  selection  ensues,  followed 
by  an  overview  of  model  characteristics  that  may  allow  cascade  solutions  of  good  quality. 

We  use  problem  B  from  Chapter  II  as  an  example  to  develop  the  heuristics.  Time 
serves  as  the  cascade  set  for  this  multi-commodity  elastic-demand  staircase  problem.  De¬ 
mand  rows  (indexed  by  i)  have  the  null  cascade  index.  Additionally,  coefficients  (oitf)  may 
be  negative  and  rows  may  represent  equalities  or  inequalities.  assume  that  staircase 
rows  are  indexed  by  the  greatest  time  period  of  any  associated  column. 

A.  THE  PROXIMAL  CASCADE 


1.  Description 

We  initialize  a  proximal  cascade  with  the  selection  of  two  parameters:  1)  cascade 
width,  caswid,  and  2)  cascade  overlap,  u.  For  subproblem  n,  define 

firstp^  =  (n  —  1)  •  [caswid  —  ti)  -1- 1 
lastp'^  —  min  [T,  (n  —  1)  •  (caswid  —  v)  +  caswid] 

for  n  =  {1, ...,  N}  such  that  lastp^~^  <  T,  lastp^  =  T.  Using  these  definitions,  the  sets 
rC”  and  TF”  are  as  defined  in  Chapter  II,  Section  B.2. 

A  proximal  cascade  subproblem  consists  of  active  columns  and  active  rows  that 
have  been  adjusted  for  the  levels  of  fixed  columns.  Fixing  a  column  implies  adjusting  the 
right-hand-sides  of  all  associated  active  rows  for  resources  consumed,  and  adjusting  the 
objective  function  value  by  the  objective  contribution  of  the  column  level. 

The  following  rules  provide  a  guide  for  solving  a  proximal  cascade: 
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•  Form  the  first  subproblem: 

Activate  all  columns  indexed  by  t  G  TC^  (production  columns,  Xu),  plus  all 
columns  indexed  only  by  i  where  n  Tj  ^  0  (elastic  columns,  Pi). 

Activate  rows  indexed  by  f  G  TC^  (staircase  rows),  ot  i  9  TC^  r\  Ti  ^  0 
(demand  rows).  In  Chapter  IPs  description  of  proximal  cascades,  demand  rows 
and  elastic  columns  are  active  in  every  subproblem;  selectively  activating  these 
rows  and  columns  reduces  subproblem  size  without  altering  the  cascade  solution. 

Solve  the  subproblem. 

•  Update  the  cascade  to  subproblem  n: 

Relax  active  rows  indexed  by:  1)  t  ^  TC”,  or  2)  i  3  TC”  n  Ti  =  0.  Fix  active 
colunms  that  meet  either  of  these  two  criteria. 

Activate  rows  indexed  by  t  G  TC”  or  z  3  TC”  fl  T  7^  0.  Activate  columns  that 
meet  the  same  criteria. 

Solve  the  subproblem. 

Repeat  the  cascade  update  until  the  final  subproblem  is  solved. 

The  objective  value  of  the  final  subproblem  is  the  proximal  cascade  solution  value. 
A  feasible  proximal  cascade  solution  is  also  feasible  to  the  monolith  because  all  columns 
are  fixed  only  after  satisfying  associated  rows. 


2.  Pseudocode  for  a  Proximal  Cascade 

We  supplement  the  guide  above  with  pseudocode  for  a  proximal  cascade.  This  code 

makes  use  of  the  same  notation  and  assumptions  as  before.  Additionally,  define  a  candidate 

row  or  column  as  one  that  has  never  been  active. 

Procedure  Proximal  Cascade 
INPUT:  caswid ,  v,  monolith  LP  B 

OUTPUT:  proximal  cascade  objective  value,  proximal  cascade  solution 

{ 

upper  J)ound  =  0 
lastp  =  0 
n  =  1 

while  Qastp  <  T)  { 

firstp  =  (n  -  1)  •  (caswid  —v)  +  1 

lastp  =  min  [T,  (n  —  1)  •  (caswid  —  v)  +  caswid] 

TC  =  {t :  firstp  <t<  lastp} 
if  (n  >  1)  { 

for  each  active  row,  { 

if  ((row  indexed  by  t  G  TC)  or  (row  indexed  by  i  3  TC  n  T  =  0))  { 
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relax  row 


} 

} 

for  each  active  column  { 

if  ((column  indexed  by  t  €  TC)  or  (column  indexed  by  i  9  TC  fl  7i  =  0))  { 
add  column  level  •  column  objective  coefficient  to  upper -bound 
for  each  active  row  associated  with  column  { 

adjust  row  RHS  by  subtracting  column  level  •  column  coefficient 

} 

record  column  level 
make  column  inactive 

} 

} 

} 

for  each  candidate  row  { 

if  ((row  indexed  by  t  €  TC”)  or  (row  indexed  by  i  9  TC  fl  T  0))  { 
make  row  active 

} 

} 

for  each  candidate  column  { 

if  ((column  indexed  by  t  G  TC)  or  (column  indexed  by  i  9  TC  fi  T  0))  { 
make  column  active 

} 

} 

solve  subproblem 
n  =  n  +  1 

} 

add  fmal  subproblem’s  active  objective  terms  to  upper -bound 
record  final  subproblem’s  active  column  levels 
report  upper-bound  as  the  proximal  cascade  objective  value 
report  recorded  column  levels  as  the  proximal  cascade  solution 

} 


3.  Parameter  Selection 


a.  Selection  of  Cascade  Width,  caswid 

Two  considerations  often  limit  cascade  width,  caswid .  The  appropriate  level 
of  model  myopia  dictates  a  corresponding  cascade  width.  Computational  considerations  can 
also  limit  cascade  width;  a  few  large  subproblems  take  longer  to  solve  than  many  short  ones 


41 


if  the  cascade  overlap  is  small. 

Usually,  the  proximal  cascade  solution  quality  increases  as  cascade  width 
increases.  Intuitively  this  is  suggested  by  the  fact  that  selecting  caswid=  T  results  in  solv¬ 
ing  the  monolith.  However,  smaller  cascade  widths  can  (counter-intuitively)  improve  the 
proximal  cascade  solution  quality.  Consider  a  2-commodity,  4-period  instance  of  problem 
B: 


=  min  Px  +Py 

s.t. 

Xi  +X2  +X3  +X4  +Px  =  10 

yi  +^2  +>3  +n  +Py  =20 

2X1  +4yi  <  20 

2X1  +4yi  +10X2  +ioy2  <20 

10X2  +ioy2  +2X3  +ioy3  <20 

2X3  +ioy3  +10X4  +y4  <20 

Xi.  yi,  X2,  y2  X3,  ya,  X4.  y4,  Px,  Py  >  0. 

Here,  Xf  =  10,  Vf  =  20,  Z^  =  0  solves  the  above  (unstated  variable 
levels  are  0  both  here  and  below). 


Now  consider  a  proximal  cascade  solution  with  caswid=  2,  t;  —  1  (3  sub¬ 


problems): 


=  min 

Px  +Py 

S.t, 

Xi  +X2 

+Px 

=  10 

1^1 

+^2 

+Py 

=  20 

2X1  +4yi 

<  20 

2X1  +4yi  +10X2 

+ioy2 

<  20 

^1,  n, 

^2, 

Y2 

Px,  Py 

>  0 

xf '  =  10,  Pf '  = 

20,  =  20), 

Z^^  =  min 

Px 

+Py 

s.t. 

X2 

+X3 

+Px 

=  10  -  Xf ' 

+Y2 

+F3 

+Py 

=  20  -  Yf^ 

10X2  -1-10^2 

<  20  -  2Xf ' 

-  4yi®' 

10X2  +ioy2 

+2X3  +ioy3 

<  20 

X2,  Y2, 

^3,  I3, 

Px, 

Py 

>  0 

(note:  Xf'  =  10,  =  2,  Pf ^  ^  jg)^  and 
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s.t. 

Xz 

2Xz 

2X3 

Xz, 


min 

Px 

+Py 

-t-X4 

+Px 

=  10  -  Xf  1  -  xp 

+^3 

+^4 

+Py 

=  20  -  YP  -  YP 

+  10^3 

<  20  -  10X2^2  _ 

+  10^3 

+10X4 

+^4 

<  20 

^3, 

A 

>4, 

Px, 

Py 

>  0 

(note:  =  20,  =  0).  Thus,  the  proximal  cascade  solution  is  =  10,  = 

20,  =  0,  as  in  the  monolith. 


However,  setting  caswid  =  3  (and  v  =  1,  resulting  in  2  subproblems)  pro¬ 
duces  a  larger  objective  value: 


Z^^'  =  min  Px  +Py 

s.t.  Xi  +X2  +Px 

n  +^2  +^3  +Py 

2X1  +4^1 

2X1  +4^1  +10X2  -M0y2 

ioj^2  -i-ioy2  -\-2X3  -1-10I3 
Xi.  n,  X2,  I2  ^3,  >3,  Px,  Py 


=  10 
=  20 

<  20 

<  20 
<20 
>0 


(note:  Y^^^'  =  5,  X^^'  =  10,  =  15,  Z^^'  =  15),  and 


s.t. 

min 

Px 

X3 

+^3 

-fX4 

+I4 

+Px 

2X3 

-blOFs 

2X3 

-(-IOI3 

+  IO-X4 

+^4 

Xs, 

^4, 

Px, 

=  10  -  xf  -  xp' 

+Py  =20-Yf^' 

<  20  -  10X2^^'  -  ioy2®^' 

<  20 
Py  >0 


(note:  —  2.5,  Yf^'  =  15,  Px^'  =  7.5,  Z^"^'  —  7.5).  Consequently,  this  proximal 

cascade  solution  is  Yf^'  =  5,  X^^'  =  2.5,  Yf^  =  15,  Px^'  =  7.5,  Z^"^'  —  7.5.  Note  that 
the  second  subproblem  is  shortened  by  the  problem’s  last  period,  T. 

Analysis  of  the  above  results  shows  that  the  caswid  —  3  case  is  “tricked”  into 
producing  commodity  Y  early  in  period  1,  while  the  caswid  =  2  case  avoids  this  mistake. 
Thus,  the  more  myopic  cascade  has  higher  solution  quality  than  the  less  myopic  one,  in  this 
instance. 
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b.  Selection  of  Cascade  Overlap,  v 

As  with  the  cascade  width,  selection  of  the  overlap  parameter  v  affects  the 
quality  of  the  proximal  cascade  solution  significantly.  At  one  extreme,  setting  v  —caswid — 1 
tends  to  produce  higher  quality  solutions,  because  each  subproblem  moves  forward  only  one 
time  period,  and  re-solves  columns  of  caswid — 1  periods.  This  increases  the  ability  of  each 
subproblem  to  respond  to  new  choices  and  restrictions  posed  by  the  added  columns  and 
rows. 

Large  cascade  overlaps  also  preserve  more  of  the  optimal  basis  from  sub¬ 
problem  to  subproblem,  so  each  solve  may  require  fewer  pivots  if  a  simplex  algorithm  is 
used.  However,  even  an  advanced  basis  may  not  overcome  the  additional  computations  as¬ 
sociated  with  large  overlaps,  so  the  overall  solution  time  may  be  longer.  Indeed,  the  results 
of  the  case  study  confirm  this. 

At  the  other  extreme,  the  cascade  overlap  v  may  be  set  equal  to  the  staircase 
overlap  m.  This  approach  minimizes  the  number  of  subproblems,  but  may  lower  solution 
quality.  However,  if  all  non-elastic  rows  have  sense  “<”  and  positive  coefficients,  feasibil¬ 
ity  is  ensured  by  setting  v  to  any  value  greater  than  or  equal  to  m.  This  is  shown  by  noting 
that  any  new  staircase  row  (not  previously  active)  of  a  subproblem  includes  columns  from  at 
most  m  periods  prior  to  the  staircase  index  t.  By  setting  v  >  m,  none  of  these  columns  are 
fixed;  hence,  all  may  be  set  to  0,  satisfying  the  row  trivially.  On  the  other  hand,  if  -y  <  m, 
infeasibility  may  result. 

Consider  the  following  single  commodity  elastic-demand  staircase  problem 
with  5  periods  and  m  =  2: 

Z*  =  min  P 


4-2^2 

+X3 

+X4 

-t-As 

+P 

= 

10 

< 

2 

-f-X2 

< 

2 

-HA2 

-I-A3 

< 

2 

-{-2JC2 

-bX3 

+X4 

< 

2 

+X3 

-fX4 

< 

2 

^1, 

X2, 

^3, 

X4, 

X5, 

P 

> 

0. 
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Here,  =  1,  X^  =  l,  X;  =  2,  P*  =  Z*  =  5. 


Now,  consider  a  proximal  cascade  with  caswid  =3,  v  =  1 : 
=  min  P 


+2X2 

+X3 

+P 

= 

10 

< 

2 

+X2 

< 

2 

+X2 

+X3 

< 

2 

Xl, 

X2, 

^3, 

P 

> 

0 

(here,  ^2^  =  2,  P^  =  =  6),  and 


=  min  P 

s.t.  X3  +X4  -\-X5  +P  =  10  —  —  2X2 

X3  <  2- XI  -  X^ 

X3  +X4  <  2-2X1  (infeasible) 

X3  +^4  +-X^5  ^  2 

X3,  X4,  X5,  P  >  0. 


This  subproblem  is  infeasible  since  the  right-hand-side  of  the  third  row  is  negative.  The 
example  shows  that  setting  the  cascade  overlap  less  than  the  staircase  overlap  can,  in  some 
cases,  result  in  infeasibility. 


4.  Desirable  Model  Characteristics  for  the  Proximal  Cascade 

There  are  several  model  characteristics  of  the  multi-commodity  elastic-demand  stair¬ 
case  problem  that  significantly  affect  the  quality  of  the  proximal  cascade  solution,  the  fore¬ 
most  being  linkage.  Demand  and  staircase  rows  with  large  widths  link  many  time  periods, 
requiring  more  rows  to  be  active  in  multiple  subproblems.  Since  later  subproblems  do  not 
communicate  these  rows’  resource  costs  to  earlier  subproblems,  the  earlier  subproblem  is 
more  apt  to  make  decisions  that  degrade  solution  quality. 

Large  staircase  overlaps  tend  to  reduce  solution  quality.  Large  overlaps  result  in 
more  relaxed  rows  associated  with  columns  of  the  active  index  set  (at  the  end  of  a  sub¬ 
problem).  Additionally,  large  overlaps  cause  more  fixed  columns  from  earlier  subproblems 
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to  alter  active  rows.  Either  condition  increases  the  opportunity  for  earlier  subproblems  to 
make  decisions  that  severely  affect  solutions  of  subsequent  subproblems. 

Cascade  solution  quality  can  be  degraded  when  the  model  is  formulated  without 
time-discoimted  demand  penalties.  Consider  a  2  commodity,  3  time  period  instance  of  B: 

Z*  =  min  Pi  +P2 


Xu 

+Pi 

= 

2 

X22 

+X23 

+P2 

= 

2 

Xu 

< 

2 

Xn 

+X22 

< 

2 

X22 

+X23 

< 

2 

Xn, 

X22, 

X23, 

Pi, 

P2 

> 

0 

This  problem  has  solution  Z*  = 

0, 

=  2, 

II 

=  2.  Now 

define  proximal  cascade 

subproblems  by  letting  caswid  = 

2,  and  V 

=  1  : 

Z^  =  min 

Pi 

+P2 

s.t. 

Xu 

+Pi 

= 

2 

X22 

+P2 

= 

2 

Xu 

< 

2 

Xu 

+X22 

< 

2 

X22, 

Pi, 

P2 

> 

0 

One  of  the  alternate  optimal  solutions  to  this  subproblem  is  Z'^  =  2,  X22  =  2,  Pi  —  2. 
Another  optimal  solution  is  Z^  =  2,  Xii  =  2,  P2  =  2. 


Z^  =  nain  Pi  +P2 

s.t.  Pi  =  2  —  Xii 


X22 

X22 

+X23 

+P2 

< 

2 

2  -  Xl, 

X22 

+X23 

< 

2 

X22, 

X23, 

Pi,  p. 

> 

0. 

Subproblem  2’s  solution  is  monolith-optimal  when  Xii  —  2,  but  not  when  ATli  —  0.  En¬ 
suring  that  subproblem  1  chooses  Xu  =  2  can  be  accomplished  by  time-discounting  the 
penalties.  Changing  the  monolith’s  objective  coefficient  on  P2  to  a  value  strictly  between  0 
and  1  would  result  in  the  correct  prioritization  of  demand  satisfaction  by  subproblem  1. 

Finally,  side  constraints  can  reduce  solution  quality  of  a  multi-commodity,  elastic- 
demand  staircase  model  that  is  solved  by  cascade.  Rows  associated  with  columns  indexed 
by  a  single  period  present  no  difficulty;  they  are  analogous  to  staircase  rows  with  no  over- 
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lap.  On  the  other  hand,  rows  that  link  many  periods  present  a  greater  challenge,  and  must 
be  assessed  individually  with  respect  to  cascade  feasibility.  The  case  study  of  the  next  chap¬ 
ter  exhibits  an  example  of  this  challenge.  The  Air  Force  model  includes  a  “utili2a.tion  rate 
constraint,”  which,  in  the  terminology  of  this  chapter’s  example,  limits  the  average  utiliza¬ 
tion  of  production  resources  over  many  time  periods.  It  is  dealt  with  by  aligning  the  periods 
over  which  utilization  is  averaged  with  the  cascade  subproblems.  Chapter  V  also  addresses 
these  situations. 

B.  THE  LAGRANGIAN  CASCADE 

We  now  describe  how  to  select  and  solve  Lagrangian  cascade  subproblems  from  the 
monolith.  Unlike  a  proximal  cascade  subproblem,  each  Lagrangian  cascade  subproblem 
preserves  none  of  the  previous  subproblem’s  solution;  it  activates  an  entirely  new  set  of 
rows  and  columns.  However,  a  Lagrangian  cascade  is  complicated  by  objective  function 
coefficient  adjustments,  demand  boimding,  and  extended  constraints. 

1.  Description 

We  initialize  a  Lagrangian  cascade  by  specifying  the  Lagrangian  cascade  width, 
Iwid.  For  subproblem  i,  define 

firstl^  =  {£  —  !)  ■  Iwid  -t- 1 
lastl^  =  min  [T,  £  ■  Iwid] 

for  f  =  {1, ...,  L}  such  that  lastl^-'^  <  T,  lastl^  =  T.  The  sets  TRL^  and  TO^  are  as 
defined  in  Chapter  II,  Section  D.l. 

Lagrangian  cascade  subproblems  may  be  solved  in  any  order.  The  following  rules 
provide  a  guide  to  solving  Lagrangian  cascade  subproblem  £: 

•  Activate  rows  whose  associated  columns  are  indexed  by  i,  or  by  t  eTRL. 

•  Lagrange-relax  rows  that  are  associated  with  a  column  indexed  by  t  eT RL^  and 
another  column  indexed  by  t  ^TRL^. 

•  Activate  and  Lagrange-relax  rows  that  serve  as  demand  bounding  rows  or  ex¬ 
tended  constraint  rows  (these  techniques  are  discussed  in  Chapter  II).  Rows  in- 
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dexed  by  i  are  demand  rows;  activate  (and  Lagrange-relax)  these  rows  with  sense 
if  some,  but  not  all  associated  columns  are  indexed  by  t  gTRL.  Activating 
extended  constraint  rows  is  more  complex;  these  rows  are  activated  if  they  have 
associated  columns  that  meet  criterion  3,  described  below. 

•  Activate  columns  that  meet  any  of  these  three  criteria: 

1)  the  column  is  indexed  by  i  3  T*  C  TRL^.  These  columns  correspond  to 
elastic  penally  variables  for  demands  that  can  only  be  met  in  this  subproblem. 

2)  the  column  is  indexed  by  t  eTRL^.  These  columns  correspond  to  those  of  the 
active  index  set. 

3)  the  column  is  indexed  by  t  €  TO^.  These  correspond  to  duplicate  columns  of 
the  “extended  constraint”  rows.  Activate  these  columns  with  an  objective  func¬ 
tion  coefficient  of  0.  Activate  rows  associated  with  these  columns  if  they  are  1) 
indexed  by  f  €  TRL^,  or  2)  the  corresponding  sense  is  and  all  coefficients 
are  non-negative.  These  rules  preserve  the  Lagrangian  bound.  For  example,  in¬ 
cluding  an  “equality”  row  indexed  by  t  €  TO^  might  cause  an  infeasibility,  since 
not  all  columns  associated  with  this  row  are  active. 

•  Solve  the  subproblem 

The  lower  bound  of  a  multiple-commodity  elastic-demand  staircase  problem  equals 
the  sum  of  all  Lagrangian  cascade  subproblem  objective  function  values,  plus  all  Lagrange- 
relaxed  right-hand-sides  multiplied  by  the  associated  Lagrange  multipliers.  The  quality  of 
that  bound  is  dependent  on  Iwid,  the  proximity  of  the  multipliers  used  to  the  monolith- 
optimal  multipliers,  and  the  structure  of  the  problem. 


2.  Pseudocode  for  a  Lagrangian  Cascade 

Mfe  supplement  the  guide  above  with  pseudocode  for  a  Lagrangian  cascade.  This 
code  makes  use  of  the  same  notation  and  assumptions  as  the  proximal  cascade  pseudocode 
Procedure  Lagrangian  Cascade 

INPUT:  Iwid,  monolith  LP  B,  Lagrange  multipliers  from  the  proximal  cascade 
OUTPUT:  Lagrangian  cascade  objective  value 

{ 

lower -bound  =  0 
lastl  =  0 

while  (lastl  <  T)  { 

firstl  =  (£—!)•  Iwid  +  1 
lastl  =  min  [T,  £  ■  lwid\ 

TRL  =  {t :  firstl  <t<  lastl} 
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TO  =  {t :  firstl  —  m<t<  firstl} 
for  each  candidate  column  { 

if  (column  indexed  by  i  9  Tj  C  TRL)  { 
activate  column 

activate  all  rows  associated  with  column 

if  (column  indexed  by  t  €  TO)  { 
activate  column 

change  column’s  objective  coefficient  to  0 
for  each  row  associated  with  column  { 
if  ((row’s  sense  is  “  <  ”)  and  (all  row’s  coefficients  >  0))  { 
activate  row 

} 

if  (row  indexed  by  t  €  TRL)  { 
activate  row 

if  ((row  indexed  by  0  and  (row’s  sense  is  “  =  ”))  { 
activate  row 

change  row’s  sense  to  “<” 

} 

} 

if  (column  indexed  by  t  G  TRL)  { 
activate  column 

for  each  row  associated  with  column  { 
if  (row  is  relaxed)  { 

add  row’s  dual  multiplier  to  column’s  objective  coefficient 
if  (row  not  indexed  by  t  >  lastl)  { 
activate  row 

if  (row  is  not  indexed  by  t)  { 
change  row’s  sense  to  “<”) 

} 

} 

} 

else  { 

activate  row 

} 

} 

} 

} 

solve  subproblem 

add  objective  value  to  lower  Jbound 
•£  =  £■(■  1 

} 
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for  each  relaxed  row  called  row  { 

add  row’s  dual  multiplier  •  row’s  RHS  to  lower -bound 

} 

report  lower -bound  as  the  Lagrangian  cascade  objective  value 

} 


3.  Parameter  Selection 

a.  Selection  of  Lagrangian  Cascade  Width,  Iwid 

Lagrangian  cascade  solution  quality  should  tend  to  improve  as  Iwid  increases. 
Additionally,  knowledge  of  the  problem  being  solved  may  be  useful  when  selecting  Iwid. 
Prior  insight  as  to  where  the  dual  multipliers  have  small  absolute  values  may  allow  selec¬ 
tion  of  rows  that  can  be  relaxed  without  sigmficantly  altering  the  objective  function  value. 
In  an  extreme  (and  unrealistic)  case,  Iwid  might  be  chosen  so  that  all  the  Lagrange-relaxed 
rows  have  optimal  monolith  solution  multipliers  of  zero,  suggesting  that  the  problem  in¬ 
stance  is  effectively  separable.  Since  prior  knowledge  of  where  weak  duals  occur  is  not 
likely,  this  topic  is  not  pursued  further 

A  related  issue  regards  selecting  Iwid  based  on  the  prior  selection  of  caswid 
and  V.  Proximal  and  Lagrangian  cascade  subproblems  whose  time  periods  roughly  coincide 
require  that  multipliers  from  the  beginning  and  end  of  a  proximal  cascade  subproblem  be 
used  by  the  Lagrangian  cascade  subproblem.  Alternatively,  choosing  Iwid  so  as  to  avoid 
alignment  of  firstl  and  firstp  exploits  the  conjecture  that  the  values  of  the  multipliers 
may  be  more  likely  to  resemble  the  monolith-optimal  ones  far  from  the  ends  of  a  proximal 
cascade  subproblem. 

As  with  a  proximal  cascade,  a  laj^er  Lagrangian  cascade  width  results  in 
fewer  subproblems  and  fewer  Lagrange-relaxed  rows.  But,  unlike  the  proximal  cascade, 
the  Lagrangian  cascade  solution  cannot  produce  a  weaker  bound  when  two  subproblems 
are  merged  by  activating  the  intervening  Lagrange-relaxed  rows.  Thus,  two  Lagrangian 
cascade  subproblems  should  always  be  merged  if  problem  size  allows,  lb  show  this,  define 
TR'  C  \JiTR^  to  be  a  subset  of  the  relaxed  periods  of  the  Lagrangian  cascade  LC  given 
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in  Chapter  11.  Further,  define  problem  LC  (with  solution  value  Z^^')  to  be  a  Lagrangian 
relaxation  of  the  same  form  as  LC  but  with  only  the  staircase  periods  for  t  e  T  B!  Lagrange- 
relaxed.  Then,  the  following  relationship  holds  between  the  solutions  of  LC,  LC,  and  B  : 


Theorem  3.1  >  Z^'  >  Z^^ . 

Proof;  The  left-hand  inequality  is  immediate  by  the  theorem  of  weak  Lagrangian  duality. 

The  right-hand  inequality  also  follows  using  weak  Lagrangian  duality,  as 
well  as  the  relationship  TB!  C 


=  min  Yh 

+  ^  (di—  Y  ~  j 

ie/  \  t€Ti  / 

+  Yi  fdf  (  S 

t&TR'  y  ie/  t'^TiCWSt 

S.t. 

iei  t'eTinTSt 

Xit,Pi  >  0  J,t  er 


Vt  ^  TB' 


>  min  Y 
iei 


-^Yj'^iidi  ~  Yl  Xit  “ 

te/  V  teTi  / 


+  Yj  Yj 

te(VeTRf)  \  i^It’eTinTSt  ) 

s-t.  Y  <  St 

i&I  t’eTiOTSt 

Xu,Pi>0  'iiei  ,teT 


Vt  ^ 


=  z^^. 


Thus,  combining  Lagrangian  cascade  subproblems  cannot  reduce  solution 
quality.  Moreover,  combining  subproblems  results  in  fewer  relaxed  rows,  so  solution  quality 
should  usually  improve. 
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b.  Selection  of  Dual  Multipliers 

The  similarity  of  the  Lagrange-relaxed  row  penalties  to  the  monolith’s  op¬ 
timal  dual  multipliers  is  key  to  the  quality  of  a  Lagrangian  cascade  objective  value.  This 
similarity  is  a  function  of  1)  the  overall  quality  of  the  corresponding  proximal  cascade,  2) 
which  proximal  cascade  subproblem  is  chosen  to  provide  the  multipliers,  and  3)  the  ap¬ 
propriateness  of  any  modifications  made  to  the  multipliers.  Improving  the  quality  of  the 
proximal  cascade  is  discussed  earlier.  In  this  section  we  discuss  how  to  choose  the  best,  or 
best  combination  of  subproblems  from  which  to  select  multipliers.  also  discuss  what 
modifications  to  these  multipliers  might  improve  the  Lagrangian  bound. 

We  offer  two  methods  for  selecting  the  proximal  cascade  subproblem  from 
which  a  Lagrangian  multiplier  is  chosen.  The  finalper  method  chooses  the  multiplier 
associated  with  the  last  subproblem  in  which  the  corresponding  row  is  active.  For  example, 
a  HffmanH  row  associated  with  columns  indexed  by  periods  5  through  25  may  be  active 
in  numerous  subproblems.  Selecting  the  last  subproblem  in  which  period  25  is  active  may 
give  the  best  representation  of  the  difficulty  required  to  satisfy  that  particular  demand.  Since 
earlier  subproblems  include  only  a  limited  number  of  time  periods  to  meet  the  demand,  the 
Lagrange  multiplier  may  reflect  an  exaggerated  marginal  cost  of  constraint  satisfaction. 

A  more  promising  technique  of  multiplier  selection  averages  the  dual  mul¬ 
tipliers  from  all  subproblems  in  which  a  row  is  active,  weighted  by  the  number  of  periods 
active  in  that  row.  This  strategy  allows  the  dual  variable  to  reflect  a  temporal  sampling 
of  the  resource  costs  involved  in  satisfying  that  constraint.  This  method,  avgper,  provides 
better  bounds  in  the  case  study,  and  is  used  throughout. 

A  potential  difficulty  of  multiplier  selection  involves  the  situation  where 
finalpev  or  avgper  computes  a  penalty  for  a  Lagrange-relaxed  demand  row  that  is  zero 
or  close  to  zero.  The  resulting  incentive  for  a  Lagrangian  cascade  to  satisfy  demand  is 
negligible- an  unlikely  situation  if  the  optimal  multiplier  is  used.  This  discrepancy  is  re¬ 
dressed  by  employing  a  pair  of  heuristic  parameters,  andmdmin.  minfrac  specifies 

a  threshold  fraction  for  a  demand  row  multiplier,  mdmin  specifies  the  modified  amount.  If 
any  demand  row  multiplier  is  less  than  minfrac  multiplied  by  the  average  of  the  demand 
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multipliers,  its  value  is  reset  to  mdmin  times  that  average.  This  technique  is  used  throughout 
the  case  study. 

4.  Desirable  Model  Characteristics  for  the  Lagrangian  Cascade 

Model  characteristics  that  affect  the  solution  quality  of  a  proximal  cascade  can  be 
expected  to  have  a  similar  affect  on  the  solution  quality  of  a  Lagrangian  cascade.  Minimiz¬ 
ing  the  number  of  Lagrange-relaxed  rows  is  paramount;  hence,  smaller  staircase  overlaps 
should  be  better.  Small  row  widths  also  reduce  the  number  of  relaxations.  Finally,  models 
that  include  any  side  constraints  whose  columns  force  a  relaxation  (by  being  active  in  more 
than  one  subproblem)  may  often  reduce  the  solution  quality  of  a  Lagrangian  cascade. 

C.  SUMMARY 

This  chapter  details  the  proximal  and  Lagrangian  cascade  heuristics  using  a  sim¬ 
ple  model  structure,  the  multi-commodity  elastic-demand  staircase  linear  program.  These 
methods  must  be  implemented  on  a  complex  model  to  be  of  real  use.  Consequently,  the 
next  chapter  is  devoted  to  applying  the  cascades  to  the  problem  motivating  the  dissertation, 
namely,  the  Air  Force  mobility  problem  as  modelled  by  the  NPS/RAND  Mobility  Optimizer. 
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IV  THE  NPS/RAND  MOBILITY  OPTIMIZER 


A.  INTRODUCTION 

The  NPS  /  RAND  Mobility  Optimizer  (NRMO)  is  under  development  as  an  alter¬ 
native  and  compliment  to  simulation  for  USAF  strategic  airlift  analysis.  Designed  in  the 
summer  of  1996,  it  is  the  consolidation  of  mobility  optimization  models  from  NPS  [Mor¬ 
ton,  Rosenthal,  and  Lim,  1995]  and  RAND  [Killingsworth  and  Melody,  1994].  The  pro]  ect  s 
sponsor  is  the  USAF  Studies  and  Analyses  Agency,  Global  Mobility  Branch. 

Strategic  airlift  is  defined  as:  “...the  movement  of  units,  persormel  and  material  in 
support  of  all  Department  of  Defense  agencies  between  the  continental  United  States  and 
overseas  areas”  [US  Air  Force,  1992,  p.  301].  Although  this  definition  embodies  many 
missions,  a  primary  goal  of  strategic  airlift  is  to  maximize  the  on-time  delivery  of  combat 
and  support  forces  to  any  foreign  region  specified  by  the  national  command  authorities. 
NRMO  represents  strategic  airlift  as  a  multi-period,  multi-commodity  network-based  LP 
with  a  large  number  of  side  constraints.  A  model  instance  provides  insight  into  mobility 
issues  such  as  aircraft  fleet  and  infrastructure  adequacy,  as  well  as  the  identification  of 
system  bottlenecks.  Multiple  scenarios  may  be  used  to  address  questions  of  fleet  selection 
and  airfield  improvements. 

There  are  four  primary  input  requirements  of  the  NRMO  LP:  1)  the  required  cargo 
and  passenger  movements  as  delineated  by  the  Ume  Phased  Force  Deployment  Document 
(TPFDD),  a  widely  used  planning  database,  2)  the  types  and  numbers  of  available  aircraft 
and  crews,  3)  the  usable  airfields,  and  4)  the  allowable  routes  for  each  aircraft  type.  The  LP 
minimizes  the  weighted  sum  of  late  and  undelivered  cargo  penalties,  subject  to  restrictions 
such  as  aircraft  flow  balance,  aircraft  payload,  and  airfield  capacity.  The  solution  speci¬ 
fies  the  airlift  mission  assignments  by  requirement  moved,  aircraft  and  route  flown,  and 
time  delivered.  From  this  output,  information  such  as  unit  closure  (the  time  when  all  of  a 
unit’s  cargo  and  passengers  have  been  delivered)  may  be  computed.  Return  routings  and 
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airfield  saturation  levels  are  also  given  in  the  LP  solution,  as  well  as  the  marginal  values  of 
resource  5 

in  addition  to  the  four  primary  inputs,  other  data  allow  NRMO  to  model  aerial  re¬ 
fueling,  geographic  crew  movement,  and  intra-theater  airlift.  If  directed  by  the  scenario 
input,  NRMO  can  assign  dual-role  aircraft  as  either  airlifters  or  aerizil  refueling  tankers,  and 
reassign  them  as  the  contingency  warrants.  The  movement  of  crews  can  be  modelled  geo¬ 
graphically  by  balancing  their  flow  through  selected  rest  bases,  and  observing  overall  limits 
on  their  number.  Finally,  NRMO  allows  intra-theater  activity  by  alternating  selected  aircraft 
between  tactical  and  strategic  roles,  again  as  the  contingency  warrants. 

NRMO  is  a  very  complex  example  of  a  multi-commodity,  elastic  demand-staircase 
model,  '^th  some  modifications  and  additional  assumptions,  it  provides  a  good  case  study 
for  cascades.  This  chapter  develops  the  case  study  by  presenting  the  model,  and  then  states 
the  proximal  and  Lagrangian  cascade  formulations.  The  monolith  formulation  of  NRMO 
follows  [Rosenthal  et  al.  1997]. 

B.  NRMO  FORMULATION 


1.  Explanation  of  Terms  and  Acronyms 

The  following  is  a  list  of  terms  and  acronyms  used  by  the  NRMO  formulation.  As 
necessary,  these  terms  are  explained  in  greater  detail  throughout  the  formulation. 


acft 

aircraft 

APOD 

Aerial  Port  of  Debarkation 

APOE 

Aerial  Port  of  Embarkation 

AR 

Aerial  Refueling 

backchannel 

returning  an  empty  aircraft  from  an  APOD  to  an  APOE 

bed  down 

resting  location  of  tanker  or  intra-theater  aircraft 

cai^o  types; 

bulk  -  palletized 

oversize  -  typically  vehicles 

outsize  -  typically  tanks  or  helicopters 

pax  -  passengers 

chop 

assigiunent  of  aircraft  to  an  intra-theater  role 

CONUS 

Continental  United  States 

CRAF 

Civil  Reserve  Air  Fleet,  airliners  contracted  for  military  service 
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crew  stage 

divert 

FOB 

line  id 

MOG 

quick  turn 

recovery 

RON 

ston 

shuttle 

super  node 

tanker  cloud 

theater 

ute 


location  where  aircraft  get  a  fresh  aircrew 
routing  of  an  intended  AR  mission  that  failed 
Forward  Operating  Base 
delivery  requirement 

Maximum  On  Ground,  an  airfield’s  capacity 
unloading  an  aircraft  in  theater  without  servicing 
eventual  servicing  location  of  a  quick  turn  mission 
Remain  Over  Night 

short  ton  (2000  lbs.),  as  opposed  to  metric  ton  (1000  kg.) 
intra-theater  mission 

an  aggregation  of  APODS  to  reduce  the  number  of  variables 
modeling  construct  to  reduce  the  number  of  variables 
region  of  the  world  where  the  deliveries  occur 
utilization 


2.  Sets 

T  time  periods 

TWi  delivery  time  window  for  line  id  i 

Tu  a  set  of  time  periods  over  which  an  aircraft’s  flying  hours  are  limited 

FT  flow  time  periods  /  =  {1,...,  maximum  mission  time  },  used  for  flight  times 

U  the  set  of  time  blocks  that  limit  an  aircraft’s  flying  hours 

I  line  ids 

subset  of  line  ids  whose  destination  is  a  FOB 
lapd  subset  of  line  ids  whose  destination  is  an  APOD. 

/ft  dst  subset  of  line  ids  that  have  base  b  (FOB  or  APOD)  as  a  destination 

Ib,tm  subset  of  line  ids  that  have  APOD  6  as  a  transshipment  node 

Ib,sup  subset  of  line  ids  that  use  super  node  b 

C  cargo  types  {bulk,  over,  out,  pax} 

CC  cargo  types  {bulk,  over,  out} 

Ca  subset  of  cargo  types  that  can  be  carried  by  acft  a 

A  set  of  acft  types 

Ac  subset  of  acft  types  that  can  carry  cargo  type  c 

Amix  subset  of  acft  types  that  can  carry  pax  and  at  least  one  other 

cargo  type  (bulk,  over,  or  out) 

Apax  subset  of  acft  that  can  carry  passengers 

Atkr  subset  of  tanker  acft  types 

Arfl  subset  of  acft  that  can  be  refueled  by  a  tanker 

Achp  subset  of  acft  that  can  be  “chopped”,  i.e.,  assigned  to  the  theater 
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B 


set  of  all  “bases”  (APOE,  APOD,  FOB,  super,  enroute,  waypoint, 
bed  down,  and  aerial  refueling  points) 

Bsup  subset  of  bases  that  are  super  nodes 

B/o6  subset  of  bases  that  are  FOBs 

Be  subset  of  bases  that  are  embarkation  nodes 

Barp  subset  of  bases  that  are  AR  points 

Btkr  subset  of  bases  that  are  bed-down  bases  for  tankers 

BSrec  set  of  super  nodes  that  have  at  least  one  recovery  base 

B^ay  set  of  bases  that  are  enroute  navigational  waypoints 

BSb^dwn  set  of  super  nodes  that  have  6  as  the  shuttle  bed-down  node 

B Fb,sup  set  of  FOB’S  that  call  b  their  super  node  plus  the  super  node  itself 

BAb,tkT  subset  of  Barp  that  are  served  by  6  €  Btkr 

BTb^arp  subset  of  Btkr  that  serve  b  e  Barp 

Bcrw  crew  stage  bases 

R  routes 

RD  delivery  routes 

RB  backchannel  routes 

RBrec  subset  of  backchannel  routes  that  include  a  recovery  base 

RDb  delivery  routes  that  use  base  b  (terminal  node  is  a  super,  not  FOB  or  APOD) 

RDia,dir  subset  of  routes  that  can  be  flown  by  a  and  carry  i  for  direct  delivery 

RDia  trn  subset  of  routes  that  can  be  flown  by  a  and  carry  i  for  transshipment 

RBab  subset  of  backchannel  routes  that  use  b  and  can  be  flown  by  a 

RDb,div  set  of  delivery  routes  that  have  6  as  a  divert  base 

RBbldiv  set  of  backchannel  routes  that  have  6  as  a  divert  base 

Rb,<yri  routes  whose  origin  is  base  b 

Rb,d$t  routes  whose  destination  is  base  b 

3.  Data 

Mission  time  data 

rtrVar  total  travel  time  for  acft  a  to  travel  on  route  r  (periods) 

trvar  rounded  rtrVar  (integer  periods) 

retrvgjbr  travel  time  for  acft  o  to  reach  base  b  when  flying  route  r  (periods) 
etrvabr  rounded  retry obr  (integer  periods) 

moxtrVa  maximum  total  travel  time  along  any  route  for  acft  a  (integer  periods) 
msntimearf  time  flown  /  periods  into  a  mission  (hrs) 

•  hrsper  ifrtrvar  >  f  (mission  continues  throughout  /th  period) 

•  0  if  rtrVar  <  /  -  1  (mission  teminates  before  /th  period) 

•  hrsper  •  {rtrVar  -  (/  -  1))  if  /  -  1  <  rtrvar  <  f 
(mission  terminates  during  /’th  period) 
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ttrVab 

tkrtimeabb' 

tkrrateabv 


shutrateai 

sgtimeab 

gtrvi 

shuttimeia 


OtifTThGo^br 

(^HTTtGobr 


CtrVabr 

CttrVab 

dhtrvb'b 

rttrvab 

Aircraft  data 

UGWaCat 

cumacot 

CTGVJrata 

purGcapiac 


maxpaxa 

paxfraCa 

rangGfoCiar 

TGStrGWa 

USGpGUa 

dhpGTla 

tkrcqVSabr 


tkrpropabb' 

dpcta 

uratGa 

initchopab 


rounded  rttrvabr  (integer  periods) 

in-flight  time  for  tanker  a  flying  from  b  to  b'  and  back  (hrs) 
maximum  number  of  tanker  shuttles  to  AR  point  6'  per  period 
for  tanker  a  when  it  is  bedded  at  b 

maximum  number  of  in-theater  shuttles  per  aircraft  per  period 
ground  time  for  shuttle  aircraft  a  at  base  b  (hrs) 
in-theater  ground  travel  time  for  i  (periods) 
in-flight  shuttle  time  (hrs) 

same  as  msntimGarf,  but  only  includes  flying  time 
thus,  flttimGarf  <  msntimGarf,  since  all  missions 
have  some  ground  time 

ground  time  for  aircraft  a  at  base  b  when  flying  route  r  (hrs) 
offload  time  only  for  acft  a  at  base  b  when  flying  route  r 
with  recovery  used  (hrs) 

travel  time  to  6,  plus  crew  rest,  for  o  along  r  (integer  periods) 
ttrvab  plus  crew  rest  (integer  periods) 
travel  time  for  deadheading  crew  from  b'  to  b  (integer  periods) 
tanker  a  reposition  time  (approx  2  days)  from  embarkation 
or  bed-down  base  b  to  cloud  (integer  periods) 

number  of  new  acft  of  type  a  available  in  period  t 

=  J2t><t  newacat' 

ratio  of  available  crews  to  acft  a 

number  of  stons  of  unit  z’s  cargo  of  type  c  that  can  be  loaded  on  acft  a 
for  a  3200nm  flight 

maximum  number  of  pax  that  can  be  loaded  on  an  acft  of  type  a 

fraction  of  an  acft’s  capacity  that  can  be  loaded  with  pax 

fraction  of  acft  available  for  loading  when  flying  route  r  for  line  id  i 

unit  reward  for  resting  acft  a  at  base  b  ^  Be 

(maXic{purecapioc}  •  latGpcui  ■  0.01) 

usage  penalty  for  theater  aircraft  and  tanker  reassignments 

penalty  for  deadheading  crews 

amount  of  a  full  tanker  consumed  by  acft  a  refueling  at  AR  b 
on  r  (KCIO  equiv) 

proportion  of  a  fiill  tanker  (KCIO  equiv)  available  when  a  is  a  refueler 

at  base  b'  and  is  bedded  at  b 

fraction  of  AR  attempts  by  receiving  acft  a  that  fail 

number  of  hours  per  day  ftiat  aircraft  a  can  fly 

initial  acft  chopped  to  theater 
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Movement  requirements  data 

rddi  required  delivery  date 

derriic  stons  of  demand  for  line  id  i  of  type  c 

latepeui  late  penalty  (delivered  after  rddi)  for  i  per  day  per  ston 

maxlatei  maximum  number  of  time  periods  late  a  delivery  for  line  id  i  can  arrive 

nogopetii  non-delivery  penalty  per  ston  (>  latepeUi  •  maxlatei) 

Other  data  and  notational  conventions 

number  of  hours  per  period 
unit  mog  consumption  of  aircraft  a  at  base  b 
mog  efficiency  at  b 

airfield  capacity:  service  spot  hours  per  period  at  b 
1  if  argument  is  true;  0  otherwise. 

=  max{0,  x} 

complement  of  a  set  5  _ 

set  difference,  i.e.,  S\T  =  S  OT 

In  general,  constraints  and  variables  are  assumed  to  exist 
only  for  the  appropriate  combinations  of  their  indices 


hrsper 

acpkgab 

mogeffb 

mogb 

!{■) 

(x)+ 

S 

\ 


4. 


Decision  Variables 


Aircraft  mission  variables 


X  Diart 
XTiart 

X.  DRiart 
XTRiart 

XSiat 
Yart 

TKRAabb't 


Aircraft  inventory  variables 


#  of  aircraft  a  direct  delivering  i  on  route  r  departing  at  time  t 

#  of  aircraft  a  delivering  a  transshipment  load  (from  APOE  to  a 
transshipment  APOD)  of  i  on  route  r  departing  at  time  t 

#  of  aircraft  o  direct  delivering  i  on  quick  turn  route  r  departing  at  time  t 

#  of  aircraft  a  delivering  a  transshipment  load  of  i  on  quick  turn  route  r 
departing  at  time  t.  The  load  is  shuttled  after  transshippment, 

#  of  (roimd  trip)  shuttle  missions  of  type  acft  a  delivering  i  in  t 

#  of  aircraft  a  recovering  on  route  r  departing  at  t 

#  of  tanker  sorties  of  type  a  flown  from  b  €  Btkr  to  b'  G  Barp  in  t 


RONabt 
RONTabt 
RONRabt 
IRONTab 
IRONRab 
THCHOPabt 
THCHOPRabt 
TKRBajbt 


number  (#)  of  acft  of  type  a  Remaining  Over  Night  at  6  €  5e  in  t 

#  of  acft  of  type  a  “RONing”  without  recovery  in  t 

#  of  acft  of  type  a  “RONing”  with  recovery  in  t 

#  of  acft  of  type  a  initially  assigned  to  b  (non-recovery) 

#  of  acft  of  type  a  initially  assigned  to  b  (recovery) 

#  of  acft  assigned  to  super  6’s  shuttle  fleet  from  non-recovery  routes  in  t 

#  of  acft  assigned  to  super  fc’s  shuttle  fleet  from  recovery  routes  in  t 

#  of  tankers  a  whose  bed-down  base  is  6  G  Btkr  in  t 
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Aircraft  changing  roles 

ALLOCdbt  #  of  new  acft  a  allocated  to  6  e  Be  in  t 

TKRECabt  #  of  tankers  a  leaving  6  G  Be  in  t  for  service  as  a  refueler  (for  cloud) 

TKRCEabt  ^  of  tankers  a  leaving  tanker  fleet  (cloud)  in  t 

for  6  G  Be  for  cargo  hauling 

TKRBCabt  ^  of  tankers  a  leaving  b  G  Btkr  in  t 

for  reassignment  or  service  as  a  cargo  hauler 

TKRCBabt  #  of  tankers  a  being  reassigned  (from  cloud)  in  t  to 

b  G  Btkr  for  refueling 

Cargo 

DTO NSiact  stons  of  z’s  cargo  of  type  c  direct  delivered  by  a  that  will  arrive  in  t . 


TTONSiact 

STONSiact 

GTONSict 


NOGOic 

Crews 

SCREWSabt 

DHCREWSaVbt 


stons  of  i’s  cargo  of  type  c  for  transshipment  by  a  arriving  at  (the 

transshipment  node)  in  t 

stons  of  i’s  cargo  of  type  c  shuttled  by  a  in  t 

stons  of  i’s  cargo  of  type  c  ground  that  will  arrive  at  the  FOB  in  t 

Note:  when  indexed  by  “pax,”  DTONS,TTONS,  STONS, 

and  GTONS  represents  niimber,  not  stons,  of  pax. 

stons  of  i’s  cargo  of  type  c  not  delivered 

#  of  strategic  airlift  crews  available  (rested)  for  a  at  6  G  Barw 
at  the  beginning  of  time  t 

#  of  deadheading  crews  for  a  leaving  b'  at  time  t 
for  reassignment  to  b 
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5. 


Formulation 


OBJ:  Objective  function 


minimize 


lateperii  ■  {t  —  rddi)’*’  •  DTONSiact 

iei  aeAceCa,teTWi 

+  EEE  E  lateperii  •  {t  —  rddi)'^  •  STONSiact 

i&ifob  oeA  ceCo  t&TWi 

-f  lateperii  •  {t  —  rddi)'^  ■  GTONSict 

i^ifob  cec  teTWi 


+  ^2  ^2  '  NOGOic 

i^I  cGO 


-f  ^  ^  ^  ^  usepertg  •  [TffCifOPafct  +  THCHOP Rau] 

oGAc/ip  i^^Hsup 

+  m  ^^usepena-Ti^i2-BC'a6t+  X)  S  ‘ 

aeAtfcr  b€Be  teT  oSAtfcr  &6Btfcr  ter 


X  Y^dhperia- DHCREWawt 

aeA  beBe  t^T  b,b'€Bcrw  teT 

Minimize  the  sum  of;  1)  late  penalty  •  number  of  days  late  •  late  cargo  delivered  di¬ 
rectly  to  the  line  id’s  destination;  2)  late  penalty  •  number  of  days  late  •  late  cargo  shuttled 


(from  the  transshipment  base)  to  the  line  id’s  destination;  3)  late  penalty  •  number  of  days 
late  •  late  cargo  delivered  by  ground  from  the  transshipment  base;  4)  nondelivery  penalty  • 
vmdelivered  cargo;  5)  usage  penalty  •  number  of  chopped  aircraft  or  reassigned  tankers,  6) 


a  small  reward  (negative  penalty)  •  number  of  aircraft  remaining  overnight  at  an  APOE  (of¬ 
ten  CONUS,  and  thereby  near  home  station);  and  7)  crew  deadhead  penalty  •  deadheading 


crews. 


ACBALE:  aircraft  balance  at  embarkation  nodes 


E  E  XTiart  +  E  E  ^Diart 

i£lfob  T^RDbC]RDia,trn  r^RDijCxRDia^dir 

E  E  XT  Riart  +  E  E  XD  Riart 

ielfob  reRDtnRDia,tTn  r^RDbCtROi^^dir 

+/(o  G  Atkr)  '  \I'KRECaJb^  "I"  RONabt  ~  ROXabt—1  "1“  ^  ]  ^art—irvar 

r^RBab 

+ALLOCabt  + 1  {a  e  Atkr)  •  [TKRCEabt]  'ia  e  A,b  e  Be,t  eT 

Aircraft  BALance  at  apoE’s:  For  each  aircraft  type,  APOE,  and  time  period  (day); 
departing  transshipment  missions  +  departing  direct  delivery  missions  +  assignments  to 
tanker  duty  (if  aircraft  is  a  tanker)  +  overnight  resting  aircraft  =  resting  aircraft  from  yester¬ 
day  +  arriving  backchannel  missions  +  newly  assigned  aircraft  +  reassignments  from  tanker 
duty  (if  aircraft  is  a  tanker).  Note  that  direct  delivery  missions  and  transshipment  missions 
can  be  selected  to  recover  away  from  the  APOD  (XDR,  XTR)  or  recover  at  the  APOD 
(XD,  XT)  missions.  This  is  true  throughout  the  formulation,  except  as  noted. 


ACBALSUP;  aircraft  balance  at  SUPER  debarkation  nodes 


Yart  +  RONTabt  +  THCHOPaU  = 

rSRBab^^^  rec 


E  E  XTiart  —trVar 

r£RDbnRDia,trn 


-I-  E  E  X  Diart^-irvar 

TSRDb^^^ia,dir 


+RONTabt-i  +  THCHOPabt-i  + 1 {t  =  l)-  IRONTab  Va  €  A,  6  G  Bsup,  t  G  T 


AirCraft  BALance  at  SUPer’s:  A  “super”  node  is  a  surrogate  for  all  bases  in  the 
theater.  Flow  balance  is  done  with  supers,  but  MOG  is  constrained  at  the  actual  theater 
APODs  and  FOBs.  Additionally,  this  constraint  only  addresses  missions  that  recover  at  the 
APOD.  Other  missions  are  constrained  in  ACBALREC.  For  each  aircraft  type,  super,  and 
time  period,  the  departing  backchannel  missions  +  overnight  resting  aircraft  +  total  aircraft 
chopped  to  the  theater  =  arriving  transshipment  missions  +  arriving  direct  delivery  missions 
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(for  those  line  ids  whose  destination  is  an  APOD)  +  last  night’s  resting  aircraft  +  yesterday’s 
total  of  chopped  aircraft  +  the  initial  “chops”  to  theater  (if  it  is  the  first  time  period). 


ACBALREC:  aircraft  balance  at  SUPER  debarkation  nodes  with  recovery 


^  ^  Yart  +  RONRabt  "I"  THCHOP Rabt  — 

reRBabt^RBrec 


E  E 


XTRiart- 


■trVa 


+E  E  X  DRiart—trva 

i^I  T^RDfjORDia^dir 


+RONRabt-i  +  THCHOPRabt-i  +  I{t  =  1)  •  IRONRab  A, be  BSrec,  t  e  T 

AirCraft  BALance  at  supers  using  RECovery  routes:  Same  as  ACBALSUR  but 
balances  flow  for  missions  not  recovering  at  the  APOD. 


INITIRON:  allocate  initial  theater  assignments 

IRONTab  +  IRONRab  =  initchopab  Va  e  Achp,  b  e  Bgup 


INITIal  RONs  in  theater:  For  period  1  and  all  aircraft  and  supers;  the  sum  of  RONS 
at  APOD  recoveries  plus  the  RONS  at  non-APOD  recoveries  equals  the  initial  aircraft 
chopped  to  theater. 


ACALLOC:  allocate  newly  available  aircraft 

ALLOCabt  =  newacat  'iae  A,t  eT 

beB^ 

AirCraft  ALLOCation:  For  each  aircraft  type  and  time  period;  the  sum  of  all  new 
allocations  to  APOE’s  =  the  amount  newly  available. 
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SHUTLBND:  don’t  send  more  shuttles  than  available 


,  E 


XSiat 

shutratCai 


<  [THCHOPajbt  +  THCHOPRm] 


yae  A, be  B^up,  teT 


SHUTtLe  BouND:  For  each  aircraft  type,  “super”  APOD,  and  time  period;  the  num¬ 
ber  of  roimd  trip  shuttle  missions  divided  by  the  daily  number  of  roxmd  trip  missions  per 
aircraft  <  the  total  chopped  aircraft  in  the  theater. 


TKRBND:  don’t  use  more  tankers  than  available 


E 


TKRAawt 

tkrrateabb' 


< TKRBm 


Va  €  Atkrib  €  Btkr^t  6  T 


TanKeR  BouND:  For  all  tankers,  tanker  bed  down  bases,  and  time  periods:  the 
number  of  AR  sorties  flown  to  all  tracks  divided  by  the  daily  sortie  rate  <  tankers  assigned 
to  the  bed  down  base. 

CLOUDBAL:  flow  balance:  leaving  and  entering  tanker  fleet 

TKRECobt-ttrvab  ~ 

b^Be  b£,Btkr 

TKRCEabt  +  TKRCBabt  \/aeAtkr,teT 

b^Btkr 

tanker  CLOUD  BALance:  The  “tanker  cloud”  is  a  node  at  which,  as  a  modeling 
convenience,  we  assvune  role  changes  take  place  for  multi-role  aircraft  that  can  be  tankers 
or  airlifters.  The  “cloud”  serves  as  a  control  point  that  reduces  the  number  of  required 
assignment  and  de-assignment  variables.  For  all  tanker  aircraft  types  and  time  periods: 
newly  assigned  tankers  from  all  APOEs  (adjusted  for  travel  time)  +  newly  de-assigned 
tankers  from  all  tanker  bed  down  bases  (also  adjusted  for  travel  time)  =  tankers  returning  to 
all  APOEs  -I-  tankers  deploying  to  all  bed  down  bases.  Note  that  de-assigning  a  tanker  from 
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a  bed  down  base  does  not  force  it  back  to  an  APOE;  it  could  be  re-assigned  to  another  bed 


down  base. 

TKRINVT;  tanker  inventory  at  tanker  bed-downs 

TKRBCabt  +  TKRBabt  =  TKRCBabt  +  TKRBabt-i  Va  e  Atkr,  &  e  €  T 


TanKeR  IN\bnTory:  For  all  tanker  aircraft  types,  tanker  bed  down  bases,  and  time 
periods;  newly  de-assigned  tankers  +  total  tankers  assigned  =  newly  assigned  tankers  +  total 
tankers  assigned  from  last  period. 


ARMOG:  aerial  refueling  capacity  constraint 

tkTeQVSabr  '  ^ Biart—etTVabr 

d^Arfl  T^RDifDRDia^dir 

+  ^  ^  ^  ^  ^  tkveqVSabr  *  ^'^iart—etrvabr 

i&I  d^Afji  T^RJDfyC\RDiaftrn 

tkvCQVSabr  ‘  ^  D Riart—etrvabr 

+  EE  E  tkvCQVSabr  '  Riart—etrvabr 

i^I  T^RD\fC\RDia,tTn 

E  E  tkvSQVScibr  *  ^drt—etrvabr 

d^Aj^  r^RBab 

<  tkrpropajbfb  •  TKRAab'bt  ^  Barpit  ^  T 

V&BTk  ,arp 

Air  Reftaeling  MOG:  Despite  the  apparent  contradiction  of  terms,  this  constraint  is 
the  air  refueling  analog  to  airfield  MOG  —  it  constrains  the  capacity  of  an  AR  track.  For 
all  air  refueling  points  and  time  periods;  the  fuel  required  by  direct  delivery,  transshipment, 
and  backchannel  missions  hitting  the  track  in  this  time  period  <  the  amount  of  fuel  available 
from  tanker  sorties  flown  to  the  track. 
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UTE:  utilization  rate 


EE  E  E 

t£Tu  i€l  r&RDia,diT  f^FT 

+  53  53  53  •  XTiart-{f-\) 

tGTu  i€lfoh  T€RDia,tm  f&FT 

+  53  53  53  51  f^ttimearf  ■  XDRiaH-(f-l) 

t&Tu  r^RDia,dir  f^FT 

+ 53  53  5^  53  •  xTRian-if-i) 

teT-a  ielfob  r&RDia  ,trn  feFT 

"t"  5  ^  ^  ^  shuttiTnSiQ  •  X Siat  ^  ^  ^  ^  ^  ^  flttifnCarf  ■  ^^rt— (/— 1) 

ielfob  teTu  t€Tu  r€iiB6  /€FT 


+/(a  €  Atfcr)  • 


53  53  5Z  •  TKRAaWt 


[beB  tkr  ^Barp  t€7u 

+  53  53  ■  TKRECabt 

beBe  teTu 


+  53  5Z  '  ''"^^FVab  •  TKRBCabt 

bGBtkr 


< 


E 

t€Tu 


cumacat  ■  uratCa 


'^a  ^  A,u  E  U 


UTilization  ratE:  Sums  all  varieties  of  flight  time,  so  the  left-hand-side  parameters 
of  this  constraint  accumulates  flight  time  only  of  missions  operating  during  blocks  of  UTE 
rate  enforcement.  The  utilization  rate  blocks  B  in  NRMO  are  defined  arbitrarily.  They  are 
motivated  by  the  fact  that  over  a  period  of  several  weeks,  an  aircraft  can  historically  fly  an 
ill  defined  average  amoimt  of  time.  Thus,  UTE  rate  blocks  are  generally  between  20  and 
30  days. 

For  each  aircraft  type  and  UTE  rate  block;  the  flight  time  of  all  direct,  transshipment, 
shuttle,  and  backchannel  missions  (as  well  as  deployed  and  deploying  tankers,  if  appropri¬ 
ate)  <  total  aircraft  hours  available  •  maximum  hours  per  day  of  average  aircraft  utilization. 
The  /  index  corresponds  to  the  number  of  days  into  a  mission,  so  when  /  =  1,  a  typical 
term  is  the  flight  time  of  a  mission’s  first  day  times  the  number  of  missions  (of  that  type) 
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lavinched  that  day.  Similarly,  when  /  =  2,  a  typical  term  corresponds  to  the  flight  time  of  a 
mission’s  second  day  times  the  number  of  missions  (of  that  type)  launched  on  the  previous 
day. 


ACCONSUME:  max  acft  usage  to  lessen  rounding  effects 


E  E  E  msntimearf  •  XDiart-{f-i) 

i^I  T^RDia,dir  f^FT 

+  E  E  E  Tyi/STl/iXTThGo^j' ^  'J- 

msntimeaTf  •  X DRiart-if-i) 

i^I  r^RDia^dir  / SFT 

+  E  E  E  msntimearf  •  XT Riart-(f-i) 

i&Ifob  reRDia,trn  f^FT 

Ehrsper 


-  •  XSiat+  msntimearf  ■  Yart-(f-l) 


hrsper 

tkrrateobb' 


+/(a  €  Atkr) '  E  E 

b^Btkr  ^Barp 

+  rttrvab  •  hrsper  ■  TKRECabt 

beBe 

+  rttrvab  ■  hrsper  •  TK RBCabt 


•  TKRAawt 


b£Btkr 


+  hrsper  ■  RONau  +  ^2  ‘  [RONTau  +  RON Rabt] 

b^Be  bsBsup 

<  hrsper  ■  cumacat 


Vfl  G  A,  t  ^  T 


Aircraft  CONSUMEd:  Structurally  similar  to  UTE,  this  constraint  reduces  the  ef¬ 
fect  of  time  discretization.  It  supplements  the  flow  balance  constraints,  which  may  deal 
with  short  missions  whose  rounded  duration  is  0  periods.  For  all  aircraft  types  and  time  pe¬ 
riods;  mission  time  of  all  direct,  transshipment,  shuttle,  and  backchannel  missions  (as  well 
as  deployed  and  deploying  tankers,  if  appropriate)  plus  resting  aircraft  <  total  aircraft  hours 
available. 
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DCAPACITY:  aircraft  capacity  for  direct  delivery 


DTONSiact  paxfracg  ■  DTON Si,a^pax,t  .  ^  ^  ) 

c&^cc  maxpaxg  ^ 

<  ^  rangefaCiar  ■  [X Diart-trvar  +  XDRiart-trvav]  '^i  ^  I,  CL  €  A,  t  €  TWi 

Direct  delivery  mission  CAIACITY:  For  each  line  id,  aircraft  type,  and  time  period; 
the  number  of  tons  delivered  (summed  over  cargo  classes)  divided  by  the  aircraft  capacity 
by  cargo  type  and  unit  +  the  passengers  delivered  divided  by  the  passenger  capacity  <  the 
number  of  missions  launched  in  support  of  i  by  aircraft  of  type  a  along  any  route,  laimched 
long  enough  ago  so  as  to  be  arriving  at  time  t.  paxfrac  specifies  the  portion  of  the  aircraft 
filled  if  fully  loaded  with  passengers.  Parameter  rangefac  is  frequently  1,  but  is  reduced  if 
a  leg  of  route  r  is  long  enough  to  exceed  the  aircraft’s  range-payload  performance. 


TCAPACITY:  aircraft  capacity  for  transshipments 


TTONSjact  paxfraCg  •  TTONSj^g^pax^t  ^  A  ) 


pZtT  S'CClJpiac 


maxpaxa 


ceCancc 

-  rangefaCiar  •  [XTigrt-trvar  +  XTRiart-trvar]  e  Ifob,  CL  ^  A,  t  £ 

reRDia  ,trn 


TWi 


Transshipment  mission  CAPACITY:  Same  as  DCAIACITY  but  applies  to  missions 
flown  in  support  of  cargo  and  pax  deliveries  to  transshipment  APODs  (for  subsequent  trans¬ 
shipment). 


SCAPACITY:  aircraft  capacity  for  shuttle  deliveries 


E 


STONSjgct 

purecapigc 


-1- 


paxfracg  •  STONSj  jCL 
maxpaXa 


'  I {^(l  ^  -^pax ) 


<  srangcig  ■  XSigt 


Vi  £  Ifobi  CL  £  A,t  £  TWi 
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Shuttle  mission  CAR^CITY:  Same  as  DCAE4.CITY  and  SCAR\CITX  hut  applies 
to  intra-theater  missions  moving  cargo  from  transshipment  APODs  to  FOBs. 


DPAXCAP:  aircraft  capacity  for  direct  delivery  of  pax 

DTON Si^a, pax, t  < 

^  maxpaXa  •  [XDiaTt-trvar  +  XDRiart-trvar]  Vi  €  /,  U  €  Amixi  t  €  TWi 

T^RDia,dir 

Direct  delivery  mission  E4X  CAPacity:  For  each  line  id,  aircraft  type,  and  time 
period;  the  number  of  pax  moved  must  not  exceed  the  maximum  pax  per  mission  •  number 
of  missions  flown.  It  supplements  DCAIACITX  which  would  (by  itself)  allow  the  aircraft 
to  be  fully  loaded  with  pax,  despite  available  seating  configurations. 

TPAXCAP:  aircraft  capacity  for  transshipment  of  pax 

TTONSi,a,pax,t  < 

maXpaXa  •  [XTiart-trvar  +  XT  Riart-trvar]  Vi  E  I  fob,  «  €  Amix,  t  E  TWi 

V^RDia^trn 


Transshipment  mission  E\X  CAPacity:  Same  as  DPAXCAP  but  applies  to  trans¬ 
shipment  missions. 

SPAXCAP:  aircraft  capacity  for  delivery  of  pax  by  shuttles 

ST  ON  Si, a, pax, t  <  rnaxpaxa  ■  XSiat  Vi  €  Ifob,  CL  G  AfYiix'i  teTWi 

Shuttle  mission  PAX  CAPacity:  Same  as  DPAXCAP  and  TPAXCAP,  but  applies  to 
intra-theater  shuttle  missions. 
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MEETDEM:  meet  demand  for  each  line  id 


E  E  DTONSiact  +  NOGOi, 

a^Ac  teTWi 


+I{i  €  Ifob) 


EE  STONSiact+  GTONSict 

laeA^  teTWi  teTWi 


=  dertiic  'ii  ^  I,c  €  C 


MEET  DEMand:  For  each  line  id  and  cargo  class;  direct  delivery  tons  (and  pax) 
moved  by  all  aircraft  over  the  available  time  window  +  tons  moved  by  shuttle  missions  (if 
destination  is  a  FOB)  +  tons  moved  by  ground  (if  destination  is  a  FOB)  +  cargo  NOT  moved 
=  demand  by  unit  and  cargo  class. 


TRANSTONS:  flow  balance  for  transshipped  stons 


TTONSiact 

CLGAc 


=  STONSiact 

a^Ac 


+GTONSict+gtrvi  •  I{t  +  gtrv.  e  TWi)  Vi  €  Ifob,  c€C, teTWi 


TRANSshipment  TONS;  For  each  line  id,  cargo  class  and  time  period;  Transship¬ 
ment  tons  moved  from  APOE  to  transshipment  APOD  by  strategic  airlift  =  tons  moved  from 
transshipment  APOD  to  FOB  by  shuttle  or  ground  transport. 


INITCREWS:  initialize  crew  placement 

Y  SCREWSou  +  crewrata-  Y  TKRBom 

b^Bcrw 

=  crewrata  •  newoCat  f  =  1 

INITialize  CREWS:  For  all  aircraft  and  time  period  1;  strategic  airlift  crews  avail¬ 
able  at  all  crew  stage  bases  +  crew  contingent  for  all  pre-deploy ed  tankers  ~  number  of 
crews  available. 
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SCREWBAL:  strategic  crew  balance  of  flow 


SCREWSabt+i  =  SCREWSabt 

+E  E  Diart— ctrvabr  ^ D Riart—ctrVabrl 

V^RDia^dir^^b  fOri 

+  E  E  [XTiart  -ctrvabr  Riart—ctrvah-^ 

i€lfob  reRDia  ttrn^^b  ,ori 

+  E  Yart—ctrVabr 

r^RBnRb^ori 

-E  E  [X Diart— etrvabr  ^ D Riart—etrvabr] 

r£RDia,dir(^^,dst 

-E  E  [XTiart  —etrVabr  ^T Riart—etrvabrl 

i^Ifob  TSRDia,trn^R'bjdst 


^  ^  Y^art—etrvabr 
r^RBnRb^dst 

+/(6  €  Be)  •  crewrota  ■  [TKRCEaju-cttrvab  ~  TKRECabt] 


+/(&  €  Bsup)' 

crewrata  ■  [THCHOPabt-i  -  THCHOPm  +  lit  =  1)  •  IRONTa,b] 

+7(6  G  BSrec)- 

crewrata  ■  [THCHOPRabt-i  ~  THCHOPRabt  +  /(t  =  1)  •  IRONRa,b] 
+7(6  e  Be,  l,newacat  >  0)  •  crewrata  •  ALLOCabt 
+  DHCREWab'bt-dhtrv,,,-  E  DHCREWabb't 

6'eBcr^ 

\fa,b€Ba-v^,  yt:{t€T,t<\T\) 


Strategic  CREW  BALance:  For  all  aircraft,  crew  stage  bases,  and  time  periods;  the 
number  of  crews  available  tomorrow  =  the  number  of  crews  available  today  +  crews  coming 
out  of  crew  rest  from  previous  direct,  transshipment,  and  backchannel  missions  -  crews 
required  for  departing  direct,  transshipment,  and  backchannel  missions + the  net  crews  made 
available  from  tanker  deployments  and  returns  (if  APOE  and  tanker  aircraft)  +  the  net  crews 
made  available  from  “chopped”  and  “unchopped”  aircraft  (if  “super”  APOD)  +  new  crew 
allocations  +  arriving  deadhead  crews  from  other  bases  -  deadhead  crews  departing  for  other 
bases. 


72 


MOG:  airfield  capacity 


^  ^  ^  ^  ^  ^  gtiTflGabr  ‘  QCpkgah  •  \X D iart—etTVabr  ^ D RiaTt—etrVab^ 

+•  EE  E  gtlTHBabr  *  ^ ^iart—trvar 

^^■^6,dst  Q.€-A  rERDia^dir 

+  EE  E  Qi/i/TThG-dbr  '  — tvvar 

i^^b^dst  ^^R^ia^dir 

+  EE  E  QtiTRGdbr  *  etruabr  -^^^-^iart—etrVafrr] 

z€/  a€v4  reiUDfeDHAa  ,trn 

+  E  E  E  gtimeabr  •  acpkgab  •  XTiart  -~trVar 

'i'^h,trn  O.SA  r€RDia,trn 

+  EE  E  QtZTTiSdbr  *  ^^P^Qcib  *  ^^art — tvvar 

'^^h.trn  Cl€A  r^RDia  ,frn 

+  E  E  sgtimeab  ■  acpkgab  ■  XSiat 

i^(^Ib,dst^^fob')^^b,trn 

+  ■  0,<^^9ab  •  [THCH OPab't  +  THCHOP Rab't] 

^RstipC\RSt}^^yjn 

+  E  E  QtZTTiCdiyp  *  ^^P^Qab  *  etr^^br 

a€>l  r£RBab 

+I{beBtkr)-  E  hrsper  •  acpkgab  •  TKRBabt 

+  EE  E  Ctpcta  *  QiZTTlCdbr  *  ^^P^Qab  '  ^^iart-’etTVabr 

i^I  CL^Arfl  T^RDbjdiv^^^itXjdir 

+E  E  E  d/pct(i  *  QtZTTlCdbf  *  CLCpkQdb  *  ^  ^ •^^art—etrvabr 

i^I  CL^Aj^  T^RDb^fiiyC\RDia,dir 

+  EE  E  dpctd  *  pti/TTiCdbr  *  ^^P^Qab  *  ^^iart—etrVabr 

iGl  a^Arfl  T^RDb^div^^^ia  ,trn 

+  EE  E  dpCtd  •  gtiTnCdbr  *  ^Cp^Oab  *  Riart—etrVabr 

iSl  Ct^Arfl  T^RJDh,divC^^^i<^ttm 

+  E  E  dpctd  ’  gtiTTiedbr  *  ^^P^Qab  '  ^aTt-etrVabr 

d^Arfl  '^^RBb,div 


■etrVabr 


-etrVabr 


<  mogb  ■  mogeffb 


^beB\  Bsup  \  Barp\  B^ay,  t  6  T 
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Maximum  On  Ground:  For  all  bases  (except  super  APODs,  AR  points,  and  way- 
points)  and  time  periods;  the  aircraft  parking  required  for  transiting  and  terminating  direct 
delivery  missions  +  parking  for  transiting  and  terminating  transshipment  missions  +  shuttle 
mission  parking  (if  FOB  or  transshipment  APOD)  +  chopped  aircraft  bed  down  parking  (if 
shuttle  bed  down  base)  +  backchannel  mission  parking  —  parking  saved  at  offload  base  by 
using  recovery  backchannel  routes  (no  fuel  or  maintenance  at  offload)  +  tanker  bed  down 
parking  (if  tanker  bed  down  base)  +  divert  base  parking  for  failed  refuelings  of  direct  de¬ 
livery,  transshipment,  and  backchannel  missions  <  available  MOG  •  MOG  efficiency. 

Non-negativity  of  all  variables. 

C.  NRMO  BY  PROXIMAL  CASCADE 

Much  of  the  NRMO  formulation  is  well  suited  to  a  proximal  cascade.  Depending  on 
the  scenario  and  which  features  of  the  airlift  system  are  modelled,  the  maximum  staircase 
overlap  m  varies  between  one  and  three  periods.  Travel  times  for  the  various  missions 
(accounted  for  by  subtracting  the  appropriate  number  of  periods  from  the  corresponding 
variables’  subscripts)  determine  the  overlap.  If  all  features  are  modelled,  the  maximum  crew 
travel  time  lag  in  the  SCREWBAL  constraint,  maxadr  [ctnw]  +  1,  usually  determines  the 
maximum  staircase  overlap.  If  crews  are  not  modeled,  either  the  maximum  mission  travel 
time,  maxor  [trvar] ,  or  the  maximum  tanker  reposition  time  max  ^rvar]  specifies  m.  The 
elastic  demand  constraint  delivery  windows  are  typically  between  1  and  10  days. 

Because  of  the  cascade  convention  stipulating  that  no  column’s  time  index  exceed 
an  associated  row’s  time  index,  we  re-define  the  GTONSict  variable.  For  the  cascade 
formulation,  GTONSict  is  the  amount  of  fs  cargo  of  type  c  transshipped  on  day  t,  but 
only  when  t  -F  gtrvi  €  TWi.  Since  GTONSict  appears  only  in  the  objective  function, 
the  MEETDEM  constraint,  and  the  TRANSTONS  constraint  (and  is  effectively  con¬ 
strained  only  by  the  latter),  the  change  has  minimal  impact  on  the  formulation.  This  adjust¬ 
ment  also  has  the  advantage  of  reducing  the  number  of  staircase  rows,  since  each 
TRANSTONS  constraint  includes  columns  from  only  one  time  period. 
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In  addition  to  the  notation  defined  previously,  let  fix{ROW'^)  represent  all  terms 
in  equation  ROW  that  were  fixed  prior  to  subproblem  n.  Stated  another  way,  fix{ROW'^) 
is  the  sum  of  all  associated  fixed  columns,  i.e.,  those  that  are  indexed  by  t  €  Un'<n^^”  • 
For  each  n  gNC^,  the  nth  subproblem  formulation  follows 
OBJ”:  Objective  function 

minimize 

EEZ  E  latepeui  •  (t  —  rddi)^  •  DTONSiact 

i^I  a£AceCa,t&TWir\TC'^ 

+  EEE  E  lateperii  ■  {t  —  rdck)'^  •  STONSiact 

i€ifob  cQCa  terWinrc" 

+  EEE  lateperii  ■  {t  +  gtrvi  —  rddi)^  ■  GTONSia 

ieif  Ob  ceC  teTC" 

+  nogoperii  ■  NOGOic  •  7  (Tj  n  TC”  ^  0) 

c€C7 

+  S  S  ^^sepena-[Ti7C7rOPaw  +  ri7OTOPJ?aM] 

a^Achp  beBsup  teTC”' 

+  E  EE  useperia  ■  TKRECabt  +  ««epen„  •  TKRBCabt 

aeAtkr  beBo  t&TC^  a€Atkr  b€Btkr  t^TC”’ 

-EEE  restrewa  •  RONabt  +  ^  ^  ^  dhpeua-  DHCREWawt 

aSA  b£Be  tsTC’'  aeA  b,V&Bcrw  t€TC^ 

+  ^2  ^2  ^•^5'dPeni  •  NOGOf^  •  I  (^lastp^'~^  <  rddi  +  maxlatei  <  lastp'^'^ 

i£l  n' <n 

+fix{obf) 

This  objective  is  similar  to  the  monolith  objective,  with  the  following  exceptions. 
Column  indexed  by  time  are  active  only  if  the  time  index  is  active.  Since  NOGOic  is  null 
indexed  (not  indexed  by  time),  it  is  active  only  if  a  period  of  the  line  id’s  delivery  window 
is  active.  The  late  penalty  on  GTONSict  is  adjusted  for  that  variable’s  re-definition. 

The  objective  also  includes  two  constants:  1) 
the  accumulated  non-delivery  penalties  from  line  id’s  whose  delivery  window  is  now  a  sub¬ 
set  of  fixed  periods;  and  2)  fix{pbf^),  the  accumulated  penalties  from  previous  subprob¬ 
lems’  columns  indexed  by  t. 
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ACBALE”:  aircraft  balance  at  embarkation  nodes 

^Tiart  +  y^  y~!  XDiart 
i€lfob  r£RDbr\RDia,trn  r€i2D6ni?Aa,dir 

y]  xriliart  +  y] 

i€//ofc  reRDi,r\RDia,trn  »€/  rC/ICbnHDio.dir 

+/(a  €  Atfc^)  •  [TKRECait]  +  RONm 

=  RONabt-l  •  I {t  —  1  ^  TC^)  +  ^  ]  Yart-trvar  '  ~  ^  ) 

r^RBab 

-\-ALLOCabt  +  /(fli  €  Atfcr)  •  [Tiiri?C^abt]  +  fi^{ACBAJjEg^) 

\fa  €  A,b  e  Be,t  e  TC"’ 


The  cascade  modification  adds  a  fixed  term,  and  shows  only  active  rows  and  columns, 
those  indexed  by  an  active  period. 


ACBALSUP":  aircraft  balance  at  SUPER  debarkation  nodes 

y]  +  RONT^t  +  THCHOPabt  = 

rGRBab^RB  rec 

E  E  XTiart-trvar  '  €  TC") 

+  S  S  XDiart-trv^r  '  /(*  “  t^Var  €  TC”) 

iG/  TSRDbnRDia^dir 

+{RONTabt-i  +  THCHOPm-i)  •  /(i  -  1  €  TCP) 

+I{t  =  1)  •  IRONTai,  +  fix{ACBALSUPabt)  W  £  A,b  e  Bsup,  t  £  TC^ 


The  cascade  modification  adds  a  fixed  term,  and  shows  only  active  rows  and  columns: 
those  indexed  by  an  active  period,  and  IRONTab  for  t  =  1. 
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ACBALREC":  aircraft  balance  at  SUPER  debarkation  nodes  with  recovery 


Yart  +  RONRabt  +  THCHOPRabt  = 

r  G  jRjBa  5  niLBrcc 

Y  Y  XTRiavt-tTVar-Ki-irVareTC'^) 

i^Ifob  rGltDb^RDia,trn 

+  Y1  XDRiart-trv^.-I{t-trVareTCn 

T^RDb^R'^iaydir 

+{RONRabt-i  +  THCHOPRabt-i)  •  /(t  -  1  €  TCP) 

+I{t  =  1)  •  IRONRab  +  fix{ACBALRECr^t)  Wae  A, be  BSrec, t  e  TC^ 

The  cascade  modification  adds  a  fixed  term,  and  shows  only  active  rows  and  columns: 
those  indexed  by  an  active  period,  and  IRONRab  for  t  =  1- 

INITIRON”:  allocate  initial  chops  to  recovery  or  not 

IRONTab  +  IRONRab  =  initchopab  Va  €  Achp,  b  €  Bsup,  n  =  \ 


The  cascade  modification  activates  rows  and  columns  of  this  constraint  only  in  the 
first  subproblem. 

AC  ALLOC":  allocate  newly  available  aircraft 

Y  ^LLOCabt  =  newocat  ^aeA,teTC^ 

b^Be 


The  cascade  modification  shows  rows  and  columns  are  active  only  if  indexed  by  an 
active  period. 

SHUTLBND":  don’t  send  more  shuttles  than  available 


E 

ieh  ,su  pDlfob 


XSiat 

shutratcai 


<  [THCHOPabt  +  THCHOPRabt] 


Mae  A, be  Bsup,t  e  TC^ 
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The  cascade  modification  shows  rows  and  columns  are  active  only  if  indexed  by  an 


active  period. 


TKRBND”:  don’t  use  more  tankers  than  available 

<  TKRBabt  Va  e  Atkr,  b  €  Btkr,  t  €  TC^ 

The  cascade  modification  shows  rows  and  columns  are  active  only  if  indexed  by  an 
active  period. 

CLOUDBAL”:  flow  balance:  leaving  and  entering  tanker  fleet 

^  TKRECabt-ttrv^,  -lit-  itrvab  e  TCr) 

b^Be 

+  TKRBCabt-ttrvJ-I{t-ttrvabeTCr) 

b€Btkr 

+fix(CLOUDBAL%)  = 

E 

6es«  frSBtfcr 

The  cascade  modification  adds  a  fixed  term,  and  shows  rows  and  columns  are  active 
only  if  indexed  by  an  active  period. 

TKRINVT":  tanker  inventory  at  tanker  bed-downs 

TKRBCabt  +  TKRBabt  =  TKRCBai>t+ 

TKRBm-i  ■  /(*  -  1  e  TC”)  +  fix{TKRINVr^)  Vo  £  A,i^,b€  Bu„t  £  TC" 

The  cascade  modification  adds  a  fixed  term,  and  shows  rows  and  columns  are  active 
only  if  indexed  by  an  active  period. 


TKRCEabt  +  Y  Vo  G  Afc,,  t  6  TC'^ 


E 


b'^BAb,tkr 


TKRAabb't 

tkrrateohv 
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ARMOG”:  aerial  refueling  capacity  constraint 


tkreqvsabr  ■  X Diart-etrvabr  '  ~  ^tf"Vabr  ^TC^) 

CL^A-rfi  T^RJDf^CMiDid^dir 

+  y^  tkreqvsabr  •  XTiaH-etw^r  •  I {i-  etrVabr  €  TC”) 

i€/  a^Arfl 

S  Y1  tkreqvsai^  ■  XDRiart-etrv^br  '  ^  TCT") 

i^I  CL^Arfl  T^RDifC\RDiQ,^cl,ir 

+  E  S  tkreqVSaJ^  •  XTRian-etrvabr  ■  lii  -  e  TC") 

i€/  a^Arfl  r^RDbC^RDia,trn 


4-  y^  y^  tkreqVSaJtrr  •  yart-etrv^br  '  -  ^trVabr  £  TC^) 

a£Ar^  r£RBab 

+fix{ARMOGl) 

<  y^  y^  tkrpropavb  ■TKRAab'bt  G  Barp,t  E.TC^ 

b'€BTb  ,orp 

The  cascade  modification  adds  a  fixed  term,  and  shows  rows  and  columns  are  active 
only  if  indexed  by  an  active  period. 


79 


UTE”;  utilization  rate 


E  E  E  E  ■  XDiart-if-l)  ’  ^  (^-(/  "  1)^ 

t€T„  ie/  rSADio.dir /€Fr 

+  E  E  E  E  •  XTiart-CZ-l)  ’  /  (*-(/  “  1)^  TC") 

i€Tu  i^Ifoh  f'^RDia.trn  f^FT 

+  E  E  E  E  f^ttvmearf  ■  XDRiart-u-i)  ’  ^  (^-(/  “  1)^ 

teTu  iei  reRDia,<iir  feFT 

+  E  E  E  E  •  XTRiart-(f-l)  '  I  {t-{f  "  l)€  TC") 

t€Tu  i^^fob  ^^FDia^trn  f^FT 


+  E  E  ia  XSiat 

i&Ifob  teTu 

+  E  E  E  ■  Yart-U-l)  '  ^  (*“(/  ”1)^ 

t€T„  r€ilBi,  /€FT 


X!/  "E  tkrtimegw  •  TKRAgbb't 

b^Btkr  b' &Barp  t^Tu 


+/(Q'  G 

+  E  E  ■  TKRECaht 


b&Be  t&Tu 


+  hrsper  ■  rttrvah  •  TKRBCi 

b&Btkr  «sr„ 

<  cumaCat  ■  uratea 

t^Tu 


abt 


+  fix{UTE:J 
ya£A,  vu :  i;  n  rc"  0 


The  cascade  modification  adds  a  fixed  term,  shows  columns  are  active  only  if  in¬ 
dexed  by  an  active  period,  and  show  rows  are  active  only  if  a  time  period  in  the  ute  rate 
block  u  is  active.  Although  this  constraint  is  much  wider  than  the  cascade  overlap,  fea¬ 
sibility  is  not  jeopardized  because  of  the  constraint’s  sense.  However,  it  may  jeopardize 
proximal  cascade  quality  if  tight  in  the  solution  to  the  monolith. 
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ACCONSUME”:  max  acft  usage  to  lessen  rounding  effects 


^  ^  ^  msntimearf  ■  XDiart-{f-i)  ■  I  {t-{f  -  1)^  TC") 

i£j  r&RDia^iir  f^FT 

+  y~]  msntimearf  •  XTiart-(f-i)  •  I  (<-(/  -  1)€  TC”) 

i€^c>6  T^RDia.trn  f^FT 

y^  y^  msnUmearf  ■  XDRiart-{f-\)  ■  I  {t—if  —  1)^  TC”) 

i€/  'f'^RDia,dir  f^FT 

+  •  Xr/?iart-(/-l)  '  I  {t-{f  -  1)^  TC") 

r£RDia  ,trn  f€FT 

^  hrsper 

shutratCai  **** 

+  y^  msntimearf  ■  Yart-{f-i)  ■  I  (*-(/  -  1)^  TC") 
reHB  /eFT 


+/(a  €  Atfcr)  • 


E  E 

bGBtkr  b'SBarp 


hrsper 

tkrratSobb' 


■  TKRAabvt 


+  y^  rttrvab  •  hrsper  ■  TKRECabt 

beB^ 

+  y^  rttrVab- hrsper -TKRBCabt 

i>^Ftkr 

+  y^  hrsper  •  RONabt  +  y^  hrsper  ■  [RONTabt  +  RONRaht] 

b^Bc  b^Bsup 

+fix{ACCONSUME2^) 

<  hrsper  ■  cumacat  'ia  E  A,t  £  TC^ 

The  cascade  modification  adds  a  fixed  term,  and  shows  rows  and  columns  are  active 
only  if  indexed  by  an  active  period. 
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DCAPACITY”:  aircraft  capacity  for  direct  delivery 

DTONSiact  paxfracg  •  DTONSi,a,pax,t  .  ^  ^  ^  < 

C€^cc  maxpaxg  ^  ~ 

rangefaCiar  •  [X Diart-trv<,r  +  XDRiart-trVaT]  -lit-  trVar  eTCX') 
+fix{DCAPACITY'lJ  WieI,aeA,te  TC^  n  TWi 

The  cascade  modification  adds  a  fixed  term,  and  shows  rows  and  columns  are  active 
only  if  indexed  by  an  active  period. 


TCAPACITY”:  aircraft  capacity  for  transshipments 


TTONSiact  paxfraCg 
4—^^  _  vurecavin^  i 


■  TTONS. 


rangefacigr  •  [XTign-tw^r  +  XTRigrt-trvar] '  Ht  “  i^Vgr  €  TC^) 

T^RDia  ,trn 

+fix{TCAPACITYl^^)  Vi  e  //„6,  a  e  A,t  e  TC^  n  TWi 


The  cascade  modification  adds  a  fixed  term,  and  shows  rows  and  columns  are  active 
only  if  indexed  by  an  active  period. 


SCAPACITY”:  aircraft  capacity  for  shuttle  deliveries 


E 

ceConcc 


STONSjgct 

purecapigc 


+ 


paxfraCg  ■  STONSi^g^pax,t 
maxpaxg 


*  I ^  Apgx') 


<  srangeig  •  XSigt  i  €  Ifob,  a  £  A,t  £  TC'^  H  TWi 


The  cascade  modification  shows  rows  and  coluiims  are  active  only  if  indexed  by  an 
active  period. 
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DPAXCAP”:  aircraft  capacity  for  direct  delivery  of  pax 


DTON Si^a,,pax,t  ^ 

maxpaXa  ■  [X Diart-tWar  +  XDRiart-trvar]  '  I {t  -  tVVar  €  TC”) 
+fix{DPAXCAPU  \fi  e  I,  a  e  Amix,  t  €  TC^  n  TWi 

The  cascade  modification  adds  a  fixed  term,  and  shows  rows  and  columns  are  active 
only  if  indexed  by  an  active  period. 

TPAXCAP"^:  aircraft  capacity  for  transshipment  of  pax 

TTONSi,a,pax,t  < 

maxpaXa  •  [XTiart-trv<,r  +  XTRiart-trvar]  '  I -  tfVar  G  TCP') 

r^RDia,trn 

+fix{TPAXCAP^J  Gifob,  a  e  Amix ,  t  €  TC”  n  TWi 

The  cascade  modification  adds  a  fixed  term,  and  shows  rows  and  columns  are  active 
only  if  indexed  by  an  active  period. 

SPAXCAP”:  aircraft  capacity  for  delivery  of  pax  by  shuttles 

STONSi,a,pax,t  <  maxpaXa  ■  XS^t  Vi  6  Ifob,  a  €  Amix,  t  G  TC^  D  TWi 

The  cascade  modification  shows  rows  and  columns  are  active  only  if  indexed  by  an 
active  period. 
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MEETDEM'*:  meet  demand  for  each  line  id 


E  E  DTONSiact  +  NOGOic+fix{MEETDEMJ^^) 

a€Ac  teTC^nTWi 


+I{i  G  Ifob) 


E  E  STONSiact  +  G'^ONSict  =  derriic 

.a€Ac  teTC'CiTWi  teTC”- 

VceC,  yiiTWiOTC^  ^ 


The  cascade  modification  includes  a  term  for  fixed  deliveries,  shows  columns  are 
active  only  if  indexed  by  an  active  period,  and  shows  rows  are  active  only  if  the  delivery 
window  includes  an  active  period.  Note  also  that  GTONSict  is  defined  only  for  t + gtrvi  G 
TWi. 


TRANSTONS”:  flow  balance  for  transshipped  stons 

TTONSiact  =  STONSiact  +  GTONSict  Vi  €  Ifob,  c  €  C,  t  €  TW^  fi  TC” 

a^Ac  a^Ac 


Because  of  the  time-index  shift  in  the  GTONSict  re-definition,  this  constraint  no 
longer  links  multiple  time  periods.  Since  GTONSict  is  restricted  to  t  -f-  gtrvi  G  TWi,  the 
only  explicit  cascade  modifications  show  columns  are  active  only  if  indexed  by  an  active 
period,  and  rows  are  active  only  if  a  period  of  the  line  id’s  delivery  window  is  active. 

INITCREWS”^^:  initialize  crew  placement 

SCREW Sabt  +  crewrata  ■  TKRBabt 

beBcrw  b^Btkr 

=  crewrata  •  newacat  t  =  1 

The  cascade  modification  shows  rows  and  columns  are  only  active  for  the  first  tune 

period. 
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SCREWBAL”:  strategic  crew  balance  of  flow 

SCREWSabt+i  =  SCREWSabt  ■  I  {t  e  TCT) 

+E  E  [XDiart  —CtrVabr  +  XDRiart-ctrVaJ  '  ^  TCT) 

r^RDia,dir<^^  ,ori 

+  E  E  Diart— ctrVabr  +  XDR,art-ctrv.J  '  €  TC^) 

i^^fob  reRDia  ,trn^'^,ori 

+  yart-ctrvabr  *  Ct'f''^abr  ^  DC  ) 

r^RBC\R^^ori 

—  [^•Diart-etrvabr  “t"  -^-Di^iart-etrUabr]  ‘  ~  etrVabr  ^  T’C'  ) 

-E  E.  —etrVabr  +  XTRiart-etrv^J  '  "  etri;a6r  6  TCT) 

^^^fob  T^RJDia^trn^^^idst 

^  '  /(*  “  etr^oir  €  T(7") 

r€ilBnHb,dst 

+7(6  €  Be,t-  cttrvab^  TCT')  •  crewrata  •  TKRCEabt-cttrvab 

-I{b  e  Be,t  €.  T(T)  •  crewrata’TK RECabt 

+I{b  e  Bsup,  t-le  T(T)  ■  crewrata  ■  THCHOP^t_i 

-I{b  e  Bsup,t  e  TCy crewrata  ■  THCHOPa^t  +  7(1  €  TCT)  ■  IRONTa,b 

+7(6  G  BSrec,t-  1  ^  TCP)  •  crewrata  •  THCHOPRai,t-i 

-I{b  €  BSrect  €  rC^)  •  crewrata  •  THCHOPRabt  +  -^(1  ^  TCT”)  •  IRONRa,b 

+7(6  eBe,t^  l,newacat  >  0,t  G  TCT”)  •  crewrata  ■  ALLOCabt 

+  ^  DHCREWab'u-dktrv,,,-I{t-dhtrvb'beTC'^) 

G  Bcrw 

-  DHCREWabb'f  lit  eTCP)+fix{SCREWBAL^t+:^) 

b^  ^Bcrw 

'ia  E  A,b  E  Bcrw,  V£  :  (t  G  T,  t  +  1  G  TC”) 


In  order  to  satisfy  the  cascade  requirement  that  no  column  have  a  time  index  greater 
than  an  associated  row’s  time  index,  we  define  this  constraint  on  i  +  1 .  The  cascade  modi¬ 
fication  also  adds  a  fixed  term,  and  shows  only  active  rows  and  columns:  those  indexed  by 
an  active  period,  and  I RONTat  and  I RONRab  for  £  =  1. 
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MOG”:  airfield  capacity 


EE  E  gtimeabr  •  acpkgab  •  [X Diart-etrVabr  XDRiart-etrVabr] 

i^I  a€A  rSRDbr\RDia,diT 

■I{t  -  etrv^e  TC^) 

+  ^2  ^2  gti'^^abr  ■  O-Cpkgab  ■  XDiart-trvar  '  ~ ^ 

+  ^2  ^2  qtimealn- •  acpkgab  ■  XDRiart-trvar  ' 

i^h.dst  r€liDia,dir 

+  ^2  ^2  gtimeabr  ■  acpkgab  •  [XTiart-etrUabr  +  XT RiaH-etrvabr] 

i€/  Ct€A  T^RDh^R^iaytrn, 

■I{t-etrv^e  TC”) 

+  ^2  ^2  gtimeabr  •  acpkgab  ■  XTiart-trvar  -  lit  —  trVar  ^  TC^) 

^^^bjtrn  r^RDia,trn 

+  ^2  ^2  gtimeabr  •  acpkgab  ■  XT Riart-trvar  •  I  [t  —  trVar  ^  TC^) 

i^ib,trn  Ct^A  T^RDia,trn 

+  ^2  sgtimcab  •  acpkgab  ■  XSiat 

i€{h,dst^^fob)^h,trn 

+  ^2  ^2  k'Tsper  •  acpkgab  •  [THCHOPab't  +  THCHOPRavt] 

b^ o,^A 

+  E  E  gtimeabr  ■  acpkgab  •  Yart-etrvabr  -lit  —  etrVabr  €  TCP) 

a£A  r^RBab 


+I{b  G  Btkr) ' 


^2  hrsper  •  acpkgab -TKRBabt 

-J 

+  EE  E  dpcta  •  gtimeabr  •  acpkgab  •  X Diart-etrVabr 

i^I  a^Arfl  T€:RBb,div^R‘^i<i,dir 

■I{t  -  etrvabr  £  TC") 

+  EE  E  dpcta  ■  gtimeabr  ■  acpkgab  ■  XDRiart-etrvabr 

Ci^Arfl  T^RDb^div^^^idtdir 

■I{t  -  etrVabr  €  rC") 

+  EE  E  dpcta  •  gtimeabr  •  acpkgab  •  XTiart-etrvabr 

i^I  d^Arfl  TQ.RJD}y^fii^r\RDia,tm 

■I{t  —  etrVabr  &TC^) 

+  EE  E  dpcta  *  ptiTTlCabr  '  CbCp^Qab  ’  Riart—etrVabr 

i^I  a&Arfl  T^RDb^divC^R^ict,trn 

•I{t  -  etrVabr  €  TC”) 

+  ^2  ^  dpcta  ■  gtimeabr  ■  acpkgab  ■  Yart-elrVabr  •  I  ^trVabr  €  TCP) 

a^Arfi  r^RBb,div 

+fix{MOG'St) 

<  mogb  ■  mogeffb  '^b  €  B  \  Bsup  \  Barp\  Byjayi  t  €  TC 
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The  cascade  modification  adds  a  fixed  term,  and  shows  rows  and  columns  are  active 
only  if  indexed  by  an  active  period. 

Non-negativity  of  all  variables. 

D.  NRMO  BY  LAGRANGIAN  CASCADE 

With  the  exception  of  the  objective  function,  the  Lagrangian  cascade  formulation  of 
NRMO  is  straightforward.  Rows  indexed  by  t  eTRL^  are  active  in  subproblem  t  Addi¬ 
tionally,  rows  indexed  by  t  E  TO  ^  are  active  if  all  technological  coefficients  are  positive,  and 
the  row  has  sense  “<”.  Columns  are  active  in  subproblem  i  if  indexed  by  t  eTRL^UTO^, 
the  extended-active  set. 

In  addition  to  the  notation  used  in  Chapter  II,  define  the  following: 

aldi  Available  to  load  date,  the  first  period  in  TWi 
RX  The  set  of  rows  that  link  two  or  more  sets  T RL^. 

This  is  the  Lagrange-relaxed  constraint  set. 

Ute  rate  block  defined  as  the  active  set,  T^  =  T  RL^ 

Additionally,  any  variable  in  the  formulation  indexed  by  t  eTO  ^  (the  extended  set) 
is  a  duplicate  variable;  one  that  is  unique  to  subproblem 
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For  each  I  eCL : 

OBJ^:  Objective  function 

minimize 

EEE  E  latepeui  •  {t  —  rddi)'^  ■  DTONSiact 

i€l  aeAceCa,t&TWir\TRL( 

+  EEE  E  lateperii  ■  {t  —  rddi)'^  ■  STONSiaa 

ielf  Ob  c£Ca  t€TWinTRL‘ 

+  EE  E  lateperii  ■  {t  +  gtrvi  —  rddi)'^  •  GTONSia 

ielf  Ob  cec  teTRL^ 

+  ^Y1  ■  NOGOic  ■  I  {i:TWiC  TRL^) 

c^C 

+  E  E  E  useperia  ■  [THCHOPai,t  +  THCHOPRabt] 

o>^A.chp  t^TCYT JRJj^ 

+  EE  E  useperia  •  TKRECabt 

oeAtfcr  6€Be  t€TnTRL‘ 

+  E  E  E  useperia  •  TKRBCabt 

d^Aflcr  tSTfXTFtL^ 

restrewa  ■  RONabt 

aSA  b£Be  teTnTRL^ 

+E  E  E  dhperia  •  DHCREWawt 

cl^A  bjb^ ^Bcrw  t^TfXr RLf^ 

+£term 

The  objective  function  is  similar  to  the  monolith’s  objective  function,  but  colmnns 
are  active  only  if  indexed  by  an  active  period,  t  €  TRL^.  It  includes  the  NOGOic  colmnns 
for  a  line  id  only  if  i’s  delivery  window  is  a  subset  of  the  active  periods.  The  definition  of 
GTONSict  is  identical  to  the  one  used  in  the  proximal  cascade  formulation. 

The  objective  function  also  includes  iterm,  which  is  the  Lagrange  penalty  term  for 
all  active  columns  associated  with  Lagrange-relaxed  rows.  The  coefficient  on  each  of  the 
Lagrange  penalty  terms  in  the  objective  is  quite  complex.  Rather  than  list  them  entirely, 
we  list  the  coefficient  on  the  variable  XTiart  only.  Dual  multipliers  /3  corresponding  to 
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Lagrange-relaxed  rows  are  superscripted  with  the  row’s  name: 

EE  E  E  XTiarf  j" ^  ^  {ACBALEabt  €  RX) 

iGlfob  r€RDbr\RDia,trn  teTRL‘  UeSe 

+  E  ■  I  {ACBALSUPau  €  RX) 

b^BsxLp 

-  E  I^^S°.,^  ikreqvs^  I(ARMOGM^„^eRX) 

b^Barp 

-  E  ®f/-i)  •  flttimcarf  •  I  {t  +  if  -l)e  TRL^^'^) 

f€FT 

-  E  ■  msntimearf  ■  I  {ACCOM SU MEart+u-D  ^ 

f€FT 

■  rangefact„  ■  I  (TCAPACITYm»„„  €  RX) 

+&SZ"  ■  maxpax„  •  /  (TPAXCAPu^^^„  e  RX) 

-  E  •  I  (SCREWBALm.*i^..^  e  RX) 

b^Bcrw 

+  E  ■  ■f  (SCREW S  BX) 

6€Scriu 

-  E  •  gti'l^eabr  '  ^  (MOC?6t+etrVa6r  ^  ^X) 

b^B\Bsup\Barp\B-way 

E  /^M+trvar  •  g^i^^abr  ‘  aCpkQab  ‘  I  {MOGbt+trvar  ^  RX) 

b^B\Bs^p\Barp\B‘ujay 

-  ^  Pbt+trvar  ■  ■  9^'^'^^obr  ■  acpkgab  •  I  {MOGbt+trvar  ^  RX) 

b^B\Bs\xp\Barp\Bway 


The  Lagrangian  cascade  solution  value  is  given  by  the  sum  of  the  subproblem  objec¬ 
tive  values,  plus  the  sum  of  the  Lagrange-relaxed  row  right-hand-sides  multiplied  by  their 
associated  penalties. 
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ACBALE^:  aircraft  balance  at  embarkation  nodes 


^  ^Tiart  +  X  X  ^  Diart 

i£lfob  TGRDb^RDia.tm  r^RDbC\RDia^dir 

J2  Y1  XTRiart  +  Yl  X  XDRiart 

i€lfob  reRDf,r\RDia,trn  *€/  r&RDt,r\RDia,dir 

+7(o  €  Atkr)  •  [TiiTJ^EJCabt]  +  RONabt  =  RONaht-1  +  X^  yart-trvar 

reRBab 

+ALLOCabt  + 1  {a  €  Afcr)  •  'ia  ^  A,b  e  B,,t  e  TRL^ 

The  cascade  modification  activates  rows  and  columns  indexed  by  the  active  set,  and 
duplicates  columns  indexed  by  the  extended  set. 

ACBALSUP^;  aircraft  balance  at  SUPER  debarkation  nodes 

X)  Yart  +  RONTabt  +  THCHOPabt  = 

reRBabf^RB  rcc 

E  E  XTiart  -trVar  E  E  X  Diart— trvar 

i&IfobreRDbnRDia,tm  *€/  reRDbnRDia,dir 

+RONTabt-i  +  THCHOPabt-1  +I{t=l)-  IRONTab  ^ae  A, be  Bsup,  teTRD 

The  cascade  modification  activates  rows  and  colunms  indexed  by  the  active  set, 
and  duplicates  columns  indexed  by  the  extended  set.  IRONTab  is  only  active  in  the  first 
subproblem. 

ACBALREC^;  aircraft  balance  at  SUPER  debarkation  nodes  with  recovery 

Yart  +  RONRabt  +  THCHOPRabt  = 

r^RBab^^^rec 

E  E  XT  Riart  —trVar  +E  E  X  D  Riart— trvar 

ielfob  r^RDbnRDia.tm  i^^  T^RDbr\RDia,diT 

YRONRabt-i  +  THCHOPRabt-i  +  I{t  =  1) '  I RON  Rob  Va  G  A,  6  €  BSrec^t  e  TRL^ 
The  cascade  modification  activates  rows  and  columns  indexed  by  the  active  set, 
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and  duplicates  columns  indexed  by  the  extended  set.  I  RON  Rah  is  only  active  in  the  first 
subproblem. 


EVITIRON^"^:  allocate  initial  chops  to  recovery  or  not 


IRONTab  +  I  RON  Rah  =  initchopah  Va  e  Achp,  b  G  Bsup 


The  cascade  modification  activates  these  rows  and  columns  only  in  the  first  sub¬ 
problem. 

ACALLOC^:  allocate  newly  available  aircraft 

ALLOCabt  —  newaCot  Va  e  A,  t  e  TRL^ 

b€Be 

The  cascade  modification  activates  rows  and  columns  indexed  by  the  active  set. 


SHUTLBND^:  don’t  send  more  shuttles  than  available 


E 


XS, 


iat 


‘^^^bfSup^^fob 


shutratca 


<  [THCHOPaht  +  THCHOPRabt]  VaeA,bG  t  G  TRL^ 


The  cascade  modification  activates  rows  and  columns  indexed  by  the  active  set. 


TKRBND^:  don’t  use  more  tankers  than  available 


y  ^  TKRBaht  Va  G  Atkr,  b  G  Btkr,  t  G  TRL^ 

tkrrateabb' 


b'GBAb,tkr 


The  cascade  modification  activates  rows  and  columns  indexed  by  the  active  set. 
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CLOUDBAL^:  flow  balance:  leaving  and  entering  tanker  fleet 


TKRECabt-ttrVat  +  TKRBCabt-ttrv,,  = 

hQ.Be  bQBtkr 

TKRCEaht  +  53  TKRCBm  Va  €  Atkr,  t  €  TRL^ 

bGBe  bEBtkr 

The  cascade  modification  activates  rows  and  columns  indexed  by  the  active  set,  and 
duplicates  columns  indexed  by  the  extended  set. 

TKRINVT^:  tanker  inventory  at  tanker  bed-downs 

TKRBCabt  +  TKRBabt  =  TKRCBau  +  TKRBabt-i  Va  €  Atkr,  b  G  Btkr,  t  €  TRL^ 


The  cascade  modification  activates  rows  and  columns  indexed  by  the  active  set,  and 
duplicates  columns  indexed  by  the  extended  set. 


ARMOG^:  aerial  refueling  capacity  constraint 

y  ^  53  tkreqVSabr  •  X Diart-etrVabr  '  ~  €.trVabr  €  TRL  U  TO  ) 

aSA-rfl  T^RBiyC^RDia^dir 


+EE  E 

t€/  d^Arfl  T^RDiff\RDia.,tm 


tkvBQVSabr  *  ^Tiart—etrvabr 


■  I{t  -  etrv^  e  TRL‘  U  TO') 


EE  E  ■  l(t  -  etrv^  S  TRL‘  U  TO') 

T^RDff^RBifi^dir 

+  E  E  E  t>‘re<lvs^  ■  •  /(«  -  etrv*  6  TRL‘  U  TO') 

i€/  d^Arfl  T^RDb^RBia,trn 


+  53  ^  tkreqvsahr  •  Vart-etn;„..  •  /  G  TRL^  U  TO^) 

d£Arfi  r€RBab 

<  53  5!!/  tkrpropab'b  •TKRAab'bt  \/b  ^  Barp,t  ETRL^  UTO^ 

6' ^BTif^erp 
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The  cascade  modification  activates  rows  indexed  by  the  extended-active  set,  columns 
indexed  by  the  zictive  set  and  duplicates  columns  indexed  by  the  extended  set. 


UTE^:  utilization  rate 

"I  ^  ^  ^  ^  ^  flttimearf  ■  X Diart— (f—l) 

t€Ti  i^I  r€RDia,dir  f^FT 

4"  ^  ^  ^  ^  ^  ^  ]  flttZTTlCarf  '  ^Tiart—{f—l) 

+  ^  ^  ^  ^  ^  ^  ^  ^  flttiTTiearf  *  ^ DRiart—(f—l) 

t&ri  iSl  r^RDicdiv  f^FT 

+  XI  XI  •  XTRiart-{f-l) 

t&Ti  i^Ifob  r&RDia, trn  feFT 

+  X  X  ^huttimeia  ■  XSiat  +  X  X  X  •  Yart-{f-l) 

i^Ifob  t^Ti  t&Ti  reRBi,  feFT 

+I{a  €  Atkr)  •  X  X  X  ■  TKRAaWt 

^Barp 

+  X  X  ■  FttrVab  ■  TKRECabt 

b^Be  t&ri 

-\-  X^  X^  hrsper  ■  rttrvab  ■  TKRBCabt 

beBtkr  t&Ti 

<  X^  cumocat  •  uratea  'ia  €.  A 

t&Tl 

The  lack  of  utilization  block  specificity  allows  some  modeling  freedom,  hence  we 
re-defme  these  blocks  as  the  active  set:  =  TRL^.  Because  missions  launched  in  a  period 
usually  consume  flight  time  in  subsequent  periods,  the  UTE  constraint  still  overlaps  the 
previous  subproblem,  and  must  be  relaxed.  However,  since  the  majority  of  the  associated 
columns  are  indexed  by  the  active  set  (plus  some  indexed  by  the  extended  set),  enforcing 
UTE^  provides  nearly  the  same  restriction  on  the  feasible  region. 
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ACCONSUME^:  max  acft  usage  to  lessen  rounding  effects 


^  ^  ^  msntimearf  •  XDiart-u-i)  ■  I  {t-{f  -  1)  ^  TRL^  U  TO^) 

i^I  T^RDia,dir  f^FT 

+  msnUmearf  •  XTiart-{f-i)  •  I  (*-(/  -  1)  ^  TRL^  U  TO^) 

i€lfob  ‘^^RF)ia,trn  f€FT 

msntimearf  ■  XDRiaH-{f-i)  ■  I  (*“(/  -  1)  €  TRL^  U  TO^) 

i^I  T^RDia^dir  f  ^FT 

+  E  E  E  msntimearf  •  XTR^rt-{f-i)  •  I  {t-{f  "  1)  €  TRL^  U  TO^) 

T^^ROia,trn  f€FT 


+  E 

i&Ifob 


hrsper 

shutrateai 


XSi, 


iat 


+  X3  XI  •  I  {t-{f  ~  1)  ^  TRL^  U  TO^) 

r€RB  f£FT 


hrsper 

tkrrGitea^b^ 


+I{a  6  Atkr)  ’  E  E 

b^Btkr  b^^Barp 

+  rttrvab  •  hrsper  •  TKRECabt 


•  TKRAawt 


+  rttrVab  •  hrsper  ■  T K RBCabt 

^^Rtkr 

+  hrsper  ■  RONau  +  XI  hrsper  ■  [RONTabt  +  RON Rabt] 

b^Be  b^Bsup 

<  hrsper  ■  cumoCat  Va  E  A,t  E  T RL^  U  TO^ 


The  cascade  modification  activates  rows  indexed  by  the  extended-active  set,  columns 
indexed  by  the  active  set  and  duplicates  columns  indexed  by  the  extended  set. 
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DCAPACITY^:  aircraft  capacity  for  direct  delivery 


^  DTONSiact  ,  paxfraca-  DTONSi,a,pax,t  a  \ 

/  T  •  i  ( (2  t  -^pax ) 

ce^CC  P^'^^^Piac  maxpaxa 

^  ^  ^  '^O/ng&fdCiaj-  •  \X Diart— trvar  “I”  ^DRiart—trVar] 

r€RDia  ,dir 

E  I,a  €  A,t  eTRL^  nTWi 


The  cascade  modification  activates  rows  and  columns  indexed  by  the  active  set,  and 
duplicates  columns  indexed  by  the  extended  set. 


TCAPACITY^:  aircraft  capacity  for  transshipments 

TTON Siact  I  paxfraCa  •  TTONSi^a,pax,t  ^  ^ 

> - 1 - •  lid  ^  -^pax ) 

cecincc  P^^^^^Piac  maxpaXa 

“  ^  V  rClTlpcyixCiar  *  [^'I^iart-’trvar  ”1”  ^'^Riart—trvar] 

T'^RDia^trn 

Vz  E  Ifobj  ®  ^  t  E  T RL^  n  TWi 

The  cascade  modification  activates  rows  and  columns  indexed  by  the  active  set,  and 
duplicates  columns  indexed  by  the  extended  set. 

SCAPACITY^:  aircraft  capacity  for  shuttle  deliveries 

STON  Siact  paxfroca  ■  STONSi  ^a^pax^t  ^  A  ^ 

/  1  •  i  E  ^pax) 

c€^cc  maxpaXa 

<  srangcia  •  XSiat 

Vz  e  Ifob,  aE  A,  tE  TRL^  n  TWi 

The  cascade  modification  activates  rows  and  columns  indexed  by  the  active  set. 
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DPAXCAP^:  aircraft  capacity  for  direct  delivery  of  pax 


DTONSi^a,pax,t  <  ^  maxpaXa  ■  [X Diart-trv^r-  +  X D Riart-trvar] 

T^RDia,dir 

'iiel,ae  Amix,  t  €  TRL^  fl  TWi 

The  cascade  modification  activates  rows  and  colmnns  indexed  by  the  active  set,  and 
duplicates  colunms  indexed  by  the  extended  set. 

TPAXCAP^:  aircraft  capacity  for  transshipment  of  pax 

TTONSi^a,pax,t  <  ^  maxpaXa  •  [XTiart-tWar  +  XTRiart-trVar] 

rGJRJDia  ,tm 

Vi  G  Ifobi  6  Amin  ^  ^  TRL^  Pi  TWi 

The  cascade  modification  activates  rows  and  columns  indexed  by  the  active  set,  and 
duplicates  columns  indexed  by  the  extended  set. 

SPAXCAP^;  aircraft  capacity  for  delivery  of  pax  by  shuttles 

STONSi^a,pax,t  <  maxpaXa  •  XSiat  Vi  e  Ifob,  a.  G  Amixi  t  €  TRL^  fl  TWi 

The  cascade  modification  activates  rows  and  columns  indexed  by  the  active  set. 

MEETDEM^:  meet  demand  for  each  line  id 

DTONSiact  +  NOGOic 

a^Ac  t^TWi 

+/(i  G  Ifob)  •  EE  STONSiact  +  GTONSict 

ja&Ac  tSTWi  ter 

Vc  G  C,  Vi  :  TWi  Q  TRL*^ 
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The  cascade  modification  activates  this  row  only  if  the  line  id’s  delivery  window  is 
a  subset  of  the  active  set.  Thus,  many  of  these  rows  are  Lagrange-relaxed,  which  motivates 
the  following  supplemental  constraint. 


MEETDEMl^:  do  not  exceed  demand  during  each  subproblem 


EE  DTONSiact  +  I{i  €  Ifob)- 


E  E  STONSiact 

jol^Ac  tcrWi 


+  ^GTONSict 
ter 


<  derriic 


Vc  (TWi  n  [TO^  U  TRL^]  ^  0,  TWi  ^  TRL^) 


MEET  DEMand  1 :  Tons  delivered  can  never  exceed  demand  for  any  subproblem. 
This  bounds  the  DTONS,  STONS  and  GTONS  variables  when  the  MEETDEM  con¬ 
straint  is  Lagrange-relaxed.  The  cascade  modification  activates  this  constraint  whenever 
the  line  id’s  delivery  window  includes  elements  of  the  active  set,  unless  the  MEETDEM 
constraint  is  active. 


TRANSTONS^:  flow  balance  for  transshipped  stons 

^  TTONSiact  =  Y.  STONSiact  +  GTONSict  Vi  G  Ifob,  ceC,  te  TWi  n  TRL^ 

(z^Ac  Ot^Ac 


Because  of  the  time-index  shift  in  the  GTONSict  re-definition,  the  only  cascade 
modification  activates  rows  and  columns  indexed  by  t  G  TWi  fl  TRL^. 

INITCREWS^^^ :  initialize  crew  placement 

^  SCREWSobt^crewrata-  TKRBabt 

h^Bcrvj 

=  crewrata  •  newocat  t  =  1 
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The  cascade  modification  activates  these  rows  and  columns  only  in  the  first  sub¬ 


problem. 


SCREWBAL^:  strategic  crew  balance  of  flow 

SCREW  Sai,t+x  =  SCREWSabt 

-f-  E  E  Diart— CtrVabr  ^ D  R^rt—CtTVabT\ 

i^I  reRDia,dir(^^  ,ort 

+  E  E  [XTiart  -ctrVabr  “I"  RiaTt—ctrVab7\ 

T'^^fob  reRDia,trn(^^  ,ori 

+  Yart—ctrvabr 


rSRBnRb^o 


—  ^  ^  ^  ^  Diart— etWabr  ^ D Riart—etrvabr] 

i€l  r€RDia,dir^Rb^dst 

—  y  ]  y  ]  [XTiart-etrVabr  ^ 

“^^^fob  T^RDia^trn^Rbydst 


~  ^  ^  ^art-etrvabr 

r&RBnRb,dst 

+I{b  e  Be)  •  crewrata  ■  [T K RC Eabt-cttrvab  ~  TKRECabt] 

+I{b  e  Bsup)- 

crewrata  ■  [THCHOPabt-i  -  THCHOPabt  +  I{t  =  1)  •  IRONTat] 

+I{b  e  BSrec)- 

crewrata  ■  [THCHOPRabt-i  ~  THCHOPRabt  +  /(t  =  1)  •  IRONRab] 

+I{b  €  Be,t  l,neiyacat  >  0)  •  crewrata  •  ALLOCabt 
+  Y,  DHCREW^u-ik...,,-  E  DHCREWabvt 

b'&Bcrm  b'&Bcrw 

Va,6  e  Banv,  Vt :  t  G  r,t  +  1  G  TRD 

As  with  a  proximal  cascade,  this  constraint  is  defined  and  indexed  on  t  -H  1.  The 
cascade  modification  activates  rows  and  columns  indexed  by  the  active  set,  and  duplicates 
columns  indexed  by  the  extended  set.  Additionally,  IRONTab  3iid  IRONRab  active 
for  f  =  1. 


98 


MOG^:  airfield  capacity 

EE  E  gtimeabr  *  O^cpkgah  *  [X Diart-etrVabr  X D Riart-etrVabr] 

OGA  V^RDb^^^iaydir 

■I{t  -  etrv^e  TRL^  U  T(/) 

+  ^2  ^2  ^2  9'^'^''^^abr  ■  O'Cpkgab  '  XDiart-trvar  'lit  —  trVar  €  TRL^  U  TO^) 

"i’^Jbfdst  CIGA  TSRDiafdir 

+  ^2  ^2  ^2  9^'^'^^abr  ’  O'Cpkgab  '  X D Riart-trvar  '  I  {t  ~  ^  TRL  U  TO  ) 

"^^Ibydst  flSA  T^RDia^dir 

+  ^2  ^2  ^2  gtimeabr  •  OLCpkgab  ■  [XTiart-etrVabr  "*■  XT Riart-etrvabr] 

i^I  CIGA  T^RDb^R^ia^trn 

■I{t  -  etrv^e  TRL^  U  TO^) 

+  ^2  ^2  ^2  Qtimegbr  •  acpkgob  •  XTiart-trvar  •  I  {t  ~  trVar  €  TRL^  U  TO  ) 

i^Ibytrn  <l€A  vSRDia^trn 

+  Qti'rn^ahr  *  CiCpkgab  *  XT Riart-trvaT  *  ^  T/JL  U  TO  ) 

i€/6,trn  ^GA  T^RDia^trn 

+  ^2  Tj  ■  <^cpkgab  ■  XSiat 

i^(h,dst^^fob)^h,trn 

-f  hrsper  *  acpkgah '  [THCHOPab't  +  THCHOPRab't] 

b^ ^Bsup^^^bfdwn 

+  ^2  Qtimeabr  •  CLCpkgab  •  yart-etrvabr  '  I{t  ~  ^trVabr  ^  TRL  U  TO  ) 

aGA  rGRBab 


hrsper  •  ocpkgab  •  TKRBabt 


+/(6  G  Btkr) 

LaSAtfcr  -* 

+  EE  E  dpcta  •  gtimeabr  •  acpkgob  ■  X  Diart-etrvabr 
./(*  -  etruabr  €  U  TO^) 

+  EE  E  dpcta  •  gtimeabr  •  ocpkgab  •  XDRiart-etrVabr 

i^I  a^Arfl  V^RDb^div^^^ia^dir 

■I{t  —  etrvabr  €  TRL^  U  TO^) 

+  EE  E  dpcto  •  gtimeabr  •  ocpkgab  •  XTiart-etrVabv 

i£l  a£Arfl  r£RDb^div^^^ia,trn 

■I{t  —  etrVabr  G  Ti?L^  U  TO^) 

+  EE  E  dpcto  •  gtimeabr  ■  ocpkgab  ■  XTRiart  “G-tiW  f^br 

iG/  aGAy^  TSRDb^div^^^io^trn 

.I{t-etrVabr^TRL^\jTO^)  ^ 

+  ^2  dpcta  •  gtimeabr  •  ocpkgab  ■  yart-etTVabv  ’  Ht  ~  CtrVabr  €  TRL  U  TO  ) 
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The  cascade  modification  activates  rows  indexed  by  the  extended-active  set,  columns 
indexed  by  the  active  set  and  duplicates  coliimns  indexed  by  the  extended  set. 

Non-negativity  of  all  variables. 

E.  NRMO  CASCADE  RESULTS 

Because  of  its  structure  and  complexity,  NRMO  is  an  excellent  model  to  test  prox¬ 
imal  and  Lagrangian  cascades.  A  moderately  sized  scenario  consists  of  hundreds  of  line 
id’s;  large  scenarios  can  easily  overwhelm  current  computing  capabilities.  Additionally,  the 
model  should  produce  resxilts  that  are  intentionally  myopic,  since  that  is  a  characteristic  of 
the  underlying  airlift  system. 

Three  NRMO  problem  instances  are  used  to  test  cascade  performance.  The  first 
problem  is  the  primary  test  scenario  used  at  NFS  to  verify  and  validate  air  mobility  linear 
programs.  We  took  the  remaining  two  scenarios  fi'om  an  ongoing  study  by  RAND  [Stucker 
and  Melody,  1996]. 

The  performance  tests  measure  the  effect  of  three  parameters  on  the  proximal- 
Lagrangian  gap.  Typically,  lai^er  values  of  the  proximal  cascade  width,  caswid,  proxi¬ 
mal  cascade  overlap,  v,  and  Lagrangian  cascade  width,  Iwid  should  all  reduce  the  gap.  The 
tests  also  examine  the  effect  of  these  parameters  on  solution  time  when  both  simplex  and 
barrier  methods  solve  the  cascades. 

Each  of  the  three  problem  instances  is  generated  by  GAMS  [Brooke,  et  al,  1992], 
and  written  into  MPS  format.  Additionally,  the  GAMS  output  provides  a  file  that  maps 
each  row  and  column  to  its  associated  tune  index.  The  cascade  logic  executes  in  C  using 
the  CPLEX  callable  library  version  3.0  [CPLEX,  1994],  A  utility  translates  the  solution 
reported  by  CPLEX  to  a  GAMS  compatible  format.  Unless  otherwise  noted,  the  computer 
used  is  an  IBM  RS6000/590  with  512MB  of  RAM.  All  times  are  given  in  CPU  seconds. 

1.  Notional  Southwest  Asia  Scenario 

The  notional  Southwest  Asia  scenario  was  originally  designed  to  test  THRUPUT 
II  [Lim,  1994],  one  of  NRMO’s  predecessors.  It  includes  21  line  id’s,  7  aircraft  types,  35 
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routes  and  30  time  periods.  The  associated  linear  program  has  4,100  rows,  7,400  columns, 
39,000  non-zeros,  and  a  maximum  staircase  overlap  of  two  periods.  In  this  scenario,  a 
contingency  in  Southwest  Asia  (Sm)  requires  deployment  of  several  Army  and  Marine 
Corps  brigades  from  CONUS,  15  Air  Force  fighter  wings  from  CONUS  and  Europe,  and 
an  Army  mechanized  division  from  Europe.  The  requirement  intentionally  exceeds  delivery 
capacity  in  order  to  strain  the  system  and  identify  airlift  bottlenecks. 


Cascade 

Cascade 

Upper 

Lower 

Proximal 

Lagrange 

Total 

Width 

Overlap 

Bound 

Bound 

yoLlap 

Time  (sec) 

Time  (sec) 

Time  (sec) 

Monolith 

294.1 

n/a 

n/a 

n/a 

n/a 

61 

20 

5 

296.6 

286.9 

3.4 

47 

19 

66 

20 

10 

294.6 

290.0 

1.6 

57 

20 

77 

20 

15 

294.1 

292.5 

0.6 

94 

18 

112 

18 

5 

303.6 

262.0 

15,9 

46 

18 

64 

18 

10 

296.7 

287.1 

3.3 

67 

21 

88 

18 

15 

294.1 

291.6 

0.9 

124 

18 

142 

15 

5 

303.3 

275,9 

9.9 

41 

19 

60 

15 

10 

295.4 

286,3 

3.2 

73 

19 

92 

15 

12 

294.7 

285.2 

3.3 

107 

19 

126 

10 

5 

305,3 

273.7 

11.6 

41 

20 

61 

10 

7 

300.0 

266.4 

12.6 

58 

20 

78 

Table  1 .  Relative  gaps  and  solution  times  for  the  Southwest  Asia  scenario  vary  with  cascade  parameter  selection.  The  first 
two  columns  show  proximal  cascade  widths  and  overlaps;  Lagrangian  cascade  widths  are  all  15.  The  remaining  columns 
show  the  performance  (computing  times  are  in  seconds  on  an  IBM  RS6000/590  with  5 12MB  RAM).  For  example,  a  prox¬ 
imal  cascade  with  width  18  and  overlap  10  gives  an  upper  boimd  solution  value  of  296.7;  the  corresponding  Lagrangian 
lower  bound  is  287.1,  resulting  in  a  gap  of  3.3%.  The  proximal  and  Lagrange  solve  times  are  67  and  21  seconds,  respec¬ 
tively,  for  a  total  of  88  seconds.  The  first  row  of  the  table  gives  the  monolith’s  solution  value  and  time,  which  provides 
a  baseline  for  the  other  runs.  Each  test  uses  CPLEX  3.0  [CPLEX.  I994\  with  primal  simplex  method  and  steepest  edge 
pricing. 


Table  1,  and  Figures  6  and  7  illustrate  that  solution  quality  improves  with  increased 
cascade  overlap  and  width.  Figure  6  shows  a  strictly  decreasing  gap  with  increasing  cascade 
overlap  for  cascade  widths  of  18  and  20.  These  decreasing  gaps  come  at  a  computational 
cost,  however,  as  indicated  by  the  proximal  cascade  solution  times.  Figure  7  also  shows 
generally  decreasing  gaps  with  increased  cascade  width,  albeit  less  convincingly. 
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Figure  6.  Solution  gaps  for  the  Southwest  Asia  scenario  decrease  significantly  with  increased  proximal  cascade  overlap. 
The  triangles  show  the  proximal  (solid  line)  and  Lagrangian  (dotted  line)  cascade  solution  values  for  an  1 8  period  proximal 
cascade  width;  the  squares  show  the  solution  values  for  a  20  period  width.  All  Lagrangian  cascade  widths  are  15.  The 
absolute  gap,  measured  by  the  vertical  distance  between  proximal  and  Lagrangian  solution  values,  is  much  smaller  with 
a  10  period  overlap  than  a  5  period  overlap,  and  smaller  still  for  a  15  period  overlap. 


Figure  7.  Solution  gaps  for  the  SouthwestAsia  scenario  generally  decrease  as  proximal  cascade  width  increases.  Proximal 
cascade  width  has  a  smaller  effect  on  the  absolute  gap  than  the  proximal  cascade  overlap. 
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Cascade 

Cascade 

Upper 

Lower 

Proximal 

Lagrange 

Total 

Width 

Overlap 

Bound 

Bound 

yooap 

Time  (sec) 

Time  (sec) 

Time  (sec) 

Monolith 

294.1 

n/a 

n/a 

n/a 

n/a 

61 

20 

5 

296.6 

286.4 

3.6 

47 

11 

58 

20 

10 

294.6 

288.7 

2.1 

57 

10 

67 

20 

15 

294.1 

288.1 

2.1 

94 

11 

105 

18 

5 

303.6 

273,2 

11.2 

46 

11 

57 

18 

10 

296.7 

279.6 

6.1 

67 

11 

78 

18 

15 

294.1 

281.4 

4.5 

124 

10 

134 

15 

5 

303.3 

267.8 

13.3 

41 

11 

52 

15 

10 

295.4 

281.3 

5.1 

73 

10 

83 

15 

12 

294.7 

280.2 

5.1 

107 

11 

118 

10 

5 

305.3 

265.8 

14.8 

41 

11 

52 

10 

7 

300.0 

263.6 

13.8 

58 

13 

71 

Table  2.  This  table  depicts  Southwest  Asia  scenario  results  with  the  Lagrangian  cascade  width  equal  to  10.  These  results 
are  similar  to  the  Iwid  =  15  test  (see  the  previous  table),  although  the  gaps  are  slightly  larger.  This  is  due  to  the  greater 
number  of  Lagrange-relaxed  rows.  Note  that  the  Lagrangian  cascade  solves  faster  with  three  subproblems  (this  table)  than 
two  subproblems  (previous  table). 

Table  2  depicts  the  SWA  scenario  results  using  the  same  proximal  cascade  parame¬ 
ters  as  Table  1,  but  with  a  Lagrangian  cascade  width  (Iwid)  of  10.  As  expected,  the  lower 
bounds  are  weaker  for  Iwid  —  10  than  for  Iwid  =  15,  because  the  monolith  is  split  in  two 
places  for  this  relaxation.  However,  the  Lagrange  solution  times  when  Iwid  =  10  are  about 
half  as  long  as  their  Iwid  =  15  counterparts.  This  is  despite  the  fact  that  the  Iwid  =  10 
cascade  requires  one  more  subproblem  than  a  Iwid  =15  cascade. 

In  this  problem,  temporal  myopia  has  only  a  minor  effect  on  solution  quality  even 
when  the  scheduling  horizon  is  reduced  by  as  much  as  two-thirds.  When  the  proximal 
cascade  width  is  only  1 0  periods,  the  solution  values  are  still  within  4%  of  the  monolith 
solution.  Longer  solution  horizons  produce  even  closer  restilts. 

2.  European  Infrastructure  Scenario  I 

Concurrent  with  this  research,  a  RAND  Corporation  study  for  the  Office  of  the  Sec¬ 
retary  of  Defense  (OSD)  is  examining  European  air  bases  transited  by  USAF  airlifters.  The 
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purpose  of  this  study  is  to  determine  which  bases  have  insufficient  infrastructure  to  ad¬ 
equately  support  a  Major  Regional  Contingency  (MRC)  in  Southwest  Asia  [Stucker  and 
Melody,  1996].  The  problem  consists  of  220  line  id’s,  six  aircraft  types,  22  routes,  and  30 
time  periods.  Approximately  75%  of  the  scenario’s  movement  requirements  originate  in 
CONUS.  The  corresponding  linear  program  has  27,000  rows,  126,500  columns,  921,500 
non-zeros,  and  a  maximum  staircase  overlap  of  two  periods. 


Cascade 

Cascade 

Upper 

Lower 

%Gap 

Proximal 

Lagrange 

Total 

Width 

Overlap 

Bound 

Bound 

Time  (sec) 

Time  (sec) 

Time  (sec) 

Monolith 

106.1 

n/a 

n/a 

n/a 

n/a 

980 

20 

5 

108.7 

93.8 

15.8 

1010 

590 

1600 

20 

10 

106.9 

101.8 

5.0 

1260 

704 

1964 

20 

15 

106.9 

102-9 

3.9 

1907 

663 

2570 

18 

5 

107.4 

91.8 

17.0 

933 

630 

1563 

18 

10 

107,6 

98.3 

9.5 

1352 

605 

1957 

18 

15 

107.1 

100.4 

6.7 

2652 

715 

3367 

15 

5 

109.2 

84.5 

29.3 

959 

659 

1618 

15 

10 

107.6 

96.0 

12.1 

1527 

650 

2177 

15 

12 

107.5 

99.9 

7.6 

2307 

601 

2908 

10 

5 

113.3 

75.8 

49.4 

1061 

639 

1700 

10 

7 

110.9 

83.7 

32.4 

1483 

770 

2253 

Table  3.  Computational  results  for  European  Infrastructure  I  also  show  that  relative  gaps  and  solution  times  vary  with  cas¬ 
cade  parameter  selection.  The  solve  times  arc  much  longer  than  Southewst  Asia  scenario  solve  times  due  to  problem  size. 
All  runs  use  the  CPLEX3.0  Barrier  algorithm  [CPLEX,  1994].  Lagrangian  cascade  subproblems  have  15  periods  each. 
The  first  row  is  the  monolith  baseline;  subsequent  rows  show  performance  using  various  proximal  cascade  parameters. 
All  times  are  in  seconds. 


The  results  of  this  scenario  (see  Table  3,  and  Figures  8  and  9)  are  generally  consistent 
with  those  of  the  first  test.  Figure  8  shows  a  pronounced  reduction  in  gap  as  cascade  overlap 
increases,  while  Figure  9  shows  a  more  moderate  reduction  with  increased  cascade  length. 
Upper  bounds  are  of  better  quality  than  lower  bounds,  due  to  the  sensitivity  of  the  lower 
bound  to  small  errors  in  the  Lagrangian  penalties.  Thus,  the  proximal  cascade  results  show 
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Figure  8.  This  Figure  depicts  cascade  solution  values  for  the  European  I  scenario  when  proximal  cascade  overlap  is 
varied.  Proximal  cascade  overlap  has  as  large  an  effect  on  this  scenario  as  it  did  on  the  notional  Southwest  Asia  scenario. 
As  before,  increasing  the  overlap  reduces  the  gap. 
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Figure  9.  Solution  gaps  for  the  European  I  scenario  are  reduced  with  increasing  proximal  cascade  width.  These  reductions, 
although  smaller  than  those  seen  in  the  Southwest  Asia  scenario,  are  still  quite  evident. 
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that  the  effects  of  myopia  are  small,  since  most  of  the  upper  bound  solution  values  are  within 
a  few  percent  of  the  monolith  value. 


3.  European  Infrastructure  Scenario  II 

This  scenario  is  a  continuation  of  the  RAND  study  for  OSD.  However,  it  includes 
different  assumptions  regarding  international  overflight  permissions,  and  includes  a  larger 
Civil  Reserve  Air  Fleet  (CRAF)  component.  As  before,  the  problem  consists  of  220  line 
id’s  and  30  time  periods,  but  there  are  now  eight  aircraft  types  and  24  routes.  Additionally, 
the  routes  are  generally  more  circuitous  than  those  of  European  Infrastructure  I.  The  cor- 


Cascade 

Cascade 

Upper 

Lower 

Proximal 

Lagrange 

Total 

Mdth 

Overlap 

Bound 

Bound 

yo  uap 

Time  (sec) 

Time  (sec) 

Time  (sec) 

Monolith 

247.3 

n/a 

n/a 

n/a 

n/a 

860 

20 

5 

266.2 

155.7 

71.0 

726 

391 

1117 

20 

10 

251.1 

204.9 

22.5 

926 

391 

1317 

20 

15 

248.4 

206.7 

20.8 

1399 

353 

1752 

18 

5 

263.4 

156.2 

68.6 

878 

400 

1278 

18 

10 

252.0 

173.8 

45.0 

1297 

397 

1694 

18 

15 

249.5 

176.3 

41.5 

2087 

349 

2436 

15 

5 

282.5 

148.4 

90.4 

747 

352 

1099 

15 

10 

262.8 

160.1 

64.2 

1247 

373 

1620 

15 

12 

255.4 

176.8 

74.0 

1909 

378 

2287 

Table  4.  The  European  Infrastructure  II  scenario  produces  considerably  larger  gaps  than  the  first  infrastructure  scenario. 
Much  of  the  difference  results  from  a  weaker  Lagrangian  bound.  As  before,  the  proximal  and  Lagrangian  cascades  use 
the  CPLEX3.0  Barrier  algorithm  [CPLEX,  1994],  All  Lagrangian  cascades  have  15  periods  each.  Times  are  in  seconds. 


responding  linear  program  has  29,400  rows,  115,700  columns,  901,600  non-zeros,  and  a 
maximtim  staircase  overlap  of  two  periods. 

Table  4  shows  the  results  for  a  variety  of  proximal  cascade  widths  and  overlaps. 
These  results  demonstrate  that  this  problem  instance  is  more  affected  by  myopia  than  the 
first  two.  Consequently,  the  smallest  gap  computed  is  20.8%,  although  the  largest  part  of 
that  gap  results  from  a  loose  lower  bound. 
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4. 


Solve  Time  Performance 


a.  Cascade  Versus  Monolith 

The  three  scenarios  do  not  exhibit  pronounced  time  savings  when  using  cas¬ 
cades.  However,  the  test  platform  is  a  computer  with  sufficient  memory  for  monolith  so¬ 
lution  without  paging.  In  order  to  verify  that  cascades  save  time  when  memory  is  limited, 
we  reduce  the  problem  size  of  the  two  European  scenarios  by  limiting  line  id  delivery  win¬ 
dows.  This  reduction  allows  solution  by  a  Dell  Pentium  Pro  200  MHz  desktop  computer 
with  64  MB  RAM. 

Table  5  shows  that  cascades  save  up  to  80%  of  the  time  required  for  monolith 
solution.  The  savings  come  at  a  moderate  cost  in  solution  quality,  since  limited  memory 
requires  that  cascade  subproblems  have  small  widths.  This  consequence  is  minor  in  models 
such  as  NRMO,  where  myopia  should  be  enforced  regardless  of  available  memory. 


Cascade  Cascade 

Wdth  Overlap 

Upper 

Bound 

Lower 

Bound 

%Gap 

Proximal 

Seconds 

Lagrange 

Seconds 

Total 

Seconds 

%rime 

Savings 

Reduced  European  Infrastructure  I  (14,442  rows,  64,252  columns,  462,645  non-zeros): 

Monolith 

106.9 

n/a 

n/a 

n/a 

n/a 

4410 

n/a 

10  5 

116.7 

90.2 

29.4 

572 

310 

882 

80.0 

10  7 

115.3 

92.0 

25.2 

844 

310 

1154 

73.8 

15  5 

109.6 

96.1 

14.1 

4080 

310 

4390 

0.5 

Reduced  European  Infrastructure  II  (16,874  rows, 

63,336  columns,  453,663  non-zeros): 

Monolith 

239.7 

n/a 

n/a 

n/a 

n/a 

4169 

n/a 

10  5 

245.7 

178.4 

37.7 

532 

476 

1008 

75.8 

10  7 

243.0 

203.5 

19.4 

760 

480 

1240 

70.3 

15  5 

242.9 

218.1 

11.4 

2160 

480 

2640 

36.7 

Table  5.  Cascades  offer  a  significant  time  savings  when  the  monolith  cannot  be  solved  with  installed  memory.  The 
computer  used  for  these  results  is  a  Pentium  Pro  200  MHz  desktop  with  64  MB  RAM  (previous  results  use  an  IBM 
RS6000/590  with  512  MB  RAM).  The  first  row  of  each  scenario  shows  the  monolith  solution  value  and  time  using  the 
interactive  barrier  solver  [CPLEX,  1994].  The  next  two  rows  in  each  scenario  indicate  cascades  offer  a  dramatic 
time  savings  when  moderate  cascade  widths  are  used.  The  final  row  of  each  scenario  shows  that  much  or  all  of  this  savings 
is  lost  when  cascades  also  require  paging. 
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b. 


Barrier  Versus  Simplex 


The  barrier  algorithm  solves  cascades  of  the  test  scenarios  faster  than  the 
simplex  algorithm,  even  when  large  cascade  overlaps  permit  the  exploitation  of  advanced 
simplex  bases.  Figure  10  depicts  solution  speeds  for  proximal  cascades  with  different  num¬ 
bers  of  subproblems  using  the  Notional  SW\  scenario  on  the  IBM  RS6000/590.  The  first 


Figure  10.  Laige  problems  solve  much  faster  using  the  barrier  algorithm  (IBM  RS6000/590).  The  vertical  axis  shows  the 
notional  Southwest  Asia  cascade  solution  time  in  seconds;  horizontal  bands  represent  the  monolith  solution  time.  The 
horizontal  axis  shows  the  number  of  subproblems,  which  is  a  function  of  cascade  width,  caswid,  and  cascade  overlap, 
V.  The  plots  represent  the  simplex  and  barrier  times  with  caswid  fixed  at  15,  and  t;  =  5, 10,  and  12.  These  parameter 
settings  specify  the  number  of  subproblems  to  be  3, 4,  and  6,  respectively. 

impression  gleaned  from  the  figure  is  the  disparity  between  simplex  and  barrier  solve  times. 
This  is  not  surprising,  given  that  CPLEX  recommends  the  barrier  for  problems  with  more 
than  1,000  rows  and  columns  [Klotz,  1996].  However,  the  relative  trend  of  the  solve  times 
is  surprising  Compared  with  the  simplex  cascade,  the  barrier  cascade  appears  to  perform 
better  as  the  number  of  subproblems  increases,  as  shown  by  the  divergent  trend  of  the  two 
plots.  This  is  inconsistent  with  the  notion  that  simplex  cascade  subproblems  are  fully  ex¬ 
ploiting  advanced  bases.  If  that  were  true,  simplex  performance  would  improve  (relative 
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Figure  11.  This  plot  includes  the  same  data  as  in  the  previous  figure  (Notional  Southwest  Asia,  caswid  15),  but  the 
vertical  axis  depicts  the  solve  times  as  a  ratio  of  the  cascade  solution  to  the  monolith  solution.  Because  the  simplex 
ratios  are  lower  than  the  barrier  ratios,  this  figure  shows  that  simplex  cascades  perform  better  than  barrier  cascades  when 
compared  to  their  respective  monolith  solution  times. 

to  the  barrier  method)  as  the  overlap  increases,  since  more  of  the  basis  is  preserved  from 
subproblem  to  subproblem. 

Although  exploiting  advanced  bases  during  the  proximal  cascade  does  not 
appear  to  be  effective,  there  is  one  encouraging  simplex  performance  measure.  Relative  to 
their  respective  monolith  solve  times,  a  simplex  cascade  appears  to  solve  faster  than  a  barrier 
cascade.  Figure  11  illustrates  this  by  depicting  the  vertical  axis  as  the  ratio  of  cascade  to 
monolith  solve  times  for  both  simplex  and  barrier.  This  result  is  consistent  with  the  idea  that 
simplex  solve  times  increase  faster  with  problem  size  than  do  interior  point  method  solve 
times,  since  solving  the  large  monolith  is  relatively  more  time  consuming  for  the  simplex 
method.  Thus,  cascades  appear  more  attractive  when  a  barrier  algorithm  is  unavailable. 

F.  NRMO  SUMMARY 

The  NPS/RAND  Mobility  Optimization  is  the  most  detailed  military  mobility  op¬ 
timization  model  ever  built.  It  incorporates  all  the  features  of  prior  models  from  NFS  and 
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RAND,  as  well  as  some  additional  features.  As  such,  it  is  a  huge  model,  and  solving  the 
monolith  may  not  always  be  possible.  Moreover,  NRMO  models  an  imperfect  schedul¬ 
ing  process,  and  therefore  should  incorporate  myopia.  For  these  reasons,  it  provides  the 
motivation  and  initial  test  platform  for  the  combined  proximal  and  Lagrangian  cascades. 

NRMO  exhibits  the  basic  staircase  structure  required  by  proximal  and  Lagrangian 
cascades,  but  is  complicated  by  numerous  additional  constraint  types.  The  NRMO  formu¬ 
lations  in  this  chapter  illustrate  how  cascades  can  accommodate  a  wide  variety  of  constramt 
types,  although  minor  alteration  is  sometimes  required. 

Upper  bounds  from  the  proximal  cascade  are  typically  within  a  few  percent  of  mono¬ 
lith  optimal.  Lower  bounds  from  the  Lagrangian  cascade  have  generally  less  quality,  but 
are  ofren  still  within  a  few  percent  of  monolith  optimal.  Cascade  solution  times  are  less 
than  the  monolith  solution  times  when  small  cascade  overlaps  are  used,  or  when  installed 
memory  is  limited. 

M^th  the  cascades  now  demonstrated  on  a  large  and  complex  model,  some  general¬ 
ization  is  warranted.  That  generalization  is  the  subject  of  the  next  chapter. 
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V  USING  CASCADES  WITH  GENERAL  LPs 


We  now  examine  the  application  of  cascades  to  general  linear  programs.  Specifi¬ 
cally,  we  address  what  conditions  make  cascading  desirable,  and  how  to  improve  cascade 
solution  quality.  Of  foremost  concern  is  assessing  cascade  suitability,  i.e.,  whether  or  not 
a  cascade  solution  is  feasible  and  likely  to  approximate  the  monolith  solution.  A  staircase 
structure  with  minimal  row  width  (width  is  the  range  of  the  non-null  cascade  set  indices  ap¬ 
pearing  in  a  row)  is  perhaps  the  best  indicator  of  suitability,  because  all  columns  associated 
with  each  row  are  proximally  related.  We  propose  a  simple  heuristic  to  gauge  a  model  s 
staircase  structure  by  examining  a  temporal,  spatial,  or  other  ordering  of  rows  and  columns. 
Next,  we  consider  some  motivations  for  cascading:  1)  inability  to  solve  the  monolith  due  to 
its  large  size,  2)  desire  to  intentionally  induce  solution  “myopia,”  and  3)  isolation  of  sub¬ 
problems  that  may  solve  the  monolith  faster.  Cascades  are  appropriate  if  a  suitable  model 
exhibits,  or  can  be  reformulated  to  exhibit,  any  of  these.  Finally,  we  offer  several  methods 
to  incorporate  dual  information  into  a  proximal  cascade,  thereby  reducing  the  gap  between 
proximal  and  Lagrangian  cascade  solution  values. 

A.  WHEN  WILL  CASCADES  WORK? 

An  arbitrary  model  monolith  may  or  may  not  be  susceptible  to  cascade  solution. 
This  section  offers  a  method  to  select  a  cascade  index  set  that  may  facilitate  cascade  fea¬ 
sibility  and  achieve  a  good  solution.  We  also  examine  several  model  constructs  that  may 
reduce  cascade  suitability,  and  suggest  monolith  reformulations  that  are  more  amenable  to 
cascades. 


1.  Gauges  for  Cascade  Suitability 

In  order  to  determine  suitability,  we  develop  several  gauges  that  can  either  be  used  to 
evaluate  a  candidate  cascade  index  scheme,  or  to  eissess  a  reformulation  to  enhance  cascade 
suitability.  Assessing  suitability  a  priori  requires  a  cascade  index  set  that  prescribes  an 
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ordering  of  rows  and  columns.  The  key  is  to  choose  an  index  set  where  the  maximum 
and  average  row  widths  are  small;  an  arbitrary  ordering  is  not  likely  to  exhibit  this  property. 
Although  time  is  usually  the  most  intuitive  choice  for  the  cascade  index,  location  or  priority 
may  also  be  good  choices.  Ordering  by  one  of  these  index  sets  is  likely  to  reveal  the  staircase 
structure  in  a  monolith,  if  such  a  structure  exists. 

'Wb  offer  the  following  gauges  that  suggest  suitability  of  a  linear  program:  1)  the 
cascade  factor,  cctsfactor'ii  which  is  the  average  row  width  normalized  for  the  non-null 
cardinality  of  each  candidate  index  set,  2)  the  maximum  width  factor,  wt,  which  is  the 
mavimnm  normalized  row  width,  and  3)  the  always  active  rows,  allact  t,  which  is  the  num¬ 
ber  of  rows  that  have  no  correspondence  with  non-null  cascade  indices.  The  following 
definitions  and  notation  are  useful: 

•  Model  rows  and  columns  have  one  or  more  candidate  cascade  index  sets.  Each 
set  T  =  {0}  U  { 1 , 2 , . . . ,  |ri }  is  composed  of  a  null  element  and  a  non-null  ordinal 
subset.  An  example  index  is  time,  where  0  is  the  null  index  of  a  row  or  column 
without  a  time-period  index. 

•  Let  model  rows  be  labeled  by  i  =  {1, 2, ...,  |/1},  model  columns  be  labeled  by 
j  =  {l,2,...,|J|}. 

•  Let  Oij  be  the  coefficient  in  row  i  and  colunm  j. 

•  Let  tj  be  the  index  from  set  T  in  column  j. 

•  Define  maxtix  as  the  maximum  column  index  f  associated  with  row  i. 

•  Define  mintix  as  the  minimum  non-null  column  index  tj  associated  with  row  i. 
mintiT  =  0  if  all  associated  columns  are  null  indexed. 

•  Let  wtotalT  =  Y^iimaxtix  -mint  it),  the  sum  of  row  widths. 

•  Let  averagewT  —  wtotal  t  /  |f  1»  th®  mean  width  of  all  rows. 

•  Define  straddle  tr  as  the  number  of  rows  containing  non-null  elements  of  T  such 
that  maxtiT  >  t  and  mint  tr  <  t. 

With  these  definitions,  we  can  compute  the  suitability  gauges: 

.  f  averagewT  /  \T\ ,  if  mim  [straddle  tr]  >  0 

casf actor  T  |  q  jf  [straddle  tf]  =  0 

wr  {xaayii[maxt iT  —mintir])  /  |T| 

allact  T  the  number  of  labels  i  such  that  maxt  tr  =  mint  ir  =  0 
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Of  these  three  gauges,  cascade  factor  {casfactor  t)  is  the  most  comprehensive  indi¬ 
cator  of  cascade  suitability,  since  it  considers  every  row’s  non-null  width,  casf actor  t  is  zero 
if  the  problem  is  entirely  separable  into  two  or  more  subsets  of  T,  which  implies  that  prox¬ 
imal  cascade  subproblems  may  be  solved  without  loss  of  monolith  optimality.  casfactorT 
does  not  attempt  to  distinguish  the  relative  size  or  number  of  separable  subproblems. 

Proximal  and  Lagrangian  cascade  solution  qualities  are  conjectured  to  be  better 
when  casfactorT  (greater  than  0),  wt,  and  allactr  are  small.  Small  row  width  suggests 
fewer  fixed  columns  and  fewer  Lagrange-relaxed  rows  in  the  proximal  and  Lagrangian 
cascades. 

Maximum  row  width  is  also  an  important  indicator  of  cascade  suitability.  A  single 
row  that  links  all  non-null  indices  may  result  in  an  infeasible  cascade  or  a  solution  of  low 
quality,  since  satisfying  this  row  may  require  that  all  associated  columns  be  simultaneously 
active.  Consequently,  smaller  values  of  wt  should  indicate  better  cascade  suitability. 

Finally,  allactr  reports  the  number  of  rows  whose  associated  columns  have  null  in¬ 
dex  tj  =  0.  These  rows  must  be  handled  by  exception  when  forming  cascade  subproblems, 
since  they  are  not  accommodated  by  the  ordering  prescribed  by  the  candidate  index  set.  As 
with  casfactorT  and  wt,  smaller  values  of  allactT  should  indicate  better  cascade  suitability, 
since  fewer  exceptions  must  be  dealt  with. 

Although  these  gauges  may  correctly  predict  cascade  suitability,  there  are  some 
model  constructs  that  cause  them  to  give  an  incorrect  assessment.  These  gauges  can  also 
indicate  the  presence  of  model  constructs  that  may  be  altered  to  increase  cascade  suitability. 
We  discuss  several  of  these  constructs  below. 

2.  Cumulant  Constraints  Complicate  Suitability 

Small  formulation  differences  can  have  a  marked  effect  on  cascade  suitability.  Con¬ 
sider  the  staircase  form  of  a  production-inventory  constraint: 

Xt  +  It-i  ~  It  —  dt  Vt, 

where  Xt,  and  f,  represent  production  and  inventory  decision  levels  in  order  to  satisfy  a 
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specified  demand,  dt.  When  defined  for  a  contiguous  set  of  time  periods,  each  constraint 
overlaps  its  predecessor  by  one  period. 

Production-inventory  constraints  can  alternatively  be  written  in  a  cumulant  form 
[e.g.,  Johnson  and  Montgomery,  1974,  pp.  197-199]: 

t'<t  t'<t 

These  two  almost  equivalent  forms  yield  different  values  of  casfactorx-  Each  con¬ 
straint  of  the  staircase  form  has  width  two.  In  contrast,  cumulant  constraints  have  a  width 
increasing  from  1  to  |r|.  Although  a  proximal  cascade  is  unaffected,  the  cumulant  form 
may  lower  the  associated  Lagrangian  cascade’s  solution  quality  because  more  rows  must 
be  Lagrange-relaxed.  Reformulating  cumulants  as  staircase  constraints  for  the  Lagrangian 
cascade  provides  the  simplest  redress. 

Even  though  casf actor  t  gives  a  warning  when  cumulant  constraints  are  present,  the 
cumulant  form  may  improve  computational  efficiency.  Consider  these  two  basis  matrices: 
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The  basis  S  arises  from  a  set  of  tight  staircase  production  inventory  constraints,  while  the 
basis  C  derives  from  an  equivalent  set  of  cumulant  constraints.  Note  that  S  =  C~^.  Be¬ 
cause  of  sparseness  of  the  inverse,  solver  computations  could  be  significantly  reduced  by 
cumulant  constraints. 

3.  Rows  that  are  Always-Active 

A  proximal  cascade  relies  on  a  cascade  index  set  that  has  few  rows  active  in  every 
subproblem.  Rows  whose  associated  columns  all  have  nvill  cascade  index  “0”  are  always- 
active  and  are  tallied  by  the  allact  x  gauge.  Additionally,  a  row  associated  with  any  column 
with  null  index  “0”  must  be  active  until  the  null-indexed  column  is  fixed.  Inactivating  this 
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row  prior  to  fixing  the  null-indexed  column  allows  subsequent  subproblems  to  alter  the 
column’s  level,  possibly  violating  the  inactive  row. 

To  illustrate  how  always-active  constraints  can  reduce  cascade  suitability,  consider  a 
modification  of  problem  S  from  Chapter  II.  This  modification  includes  some  intermediate 
time  period  r,  and  variables  A  and  B  that  are  bounded  by  d  in  an  always-active  constraint. 

=  min  ^2 

teT 

s.t.  ^  ^  VI  <  t  <  r 

t’^TSt 

ott'Xf  +B>St  Vr  <  t  <  ir| 

t'eTSt 

A  B  d 

Xt>0\/t£T  A,B>0. 

Define  the  proximal  cascade  subproblems  as 


E  htXf+ min  Y 

n' <71  t€TC"' 


S.t.  ^  ^  att^Xf'  +  -4  > 

*•  -  E  E 

\/t£Tcr,t<T  (si.i) 

t'eTStnTC^ 

n/  <71  £TSt 

^  ^  dtvXt*  B  ^ 

s,  -  E  E 

\/t€TC^,t>T  (SI. 2) 

t*QTStr\TC'^ 

n><nfiTStr\TF’'' 

A  B  d 

(Sl.AA) 

Xt>oyt  eTcr^  A,B>o. 


Constraint  Sl.AA  must  be  active  until  both  A  and  S  are  fixed,  which  occurs  in  the  last 
subproblem.  Furthermore,  each  row  of  constraint  set  SI.  1  must  be  active  until  A  is  fixed. 
A  similar  condition  holds  with  B  for  each  row  of  SI.  2. 

This  exafriple  illustrates  that  always-active  rows  may  or  may  not  affect  cascade  suit¬ 
ability.  In  some  cases,  always-active  rows  may  cause  solution  time  to  be  increased  modestly 
by  enlarging  each  associated  subproblem.  For  example,  if  the  always-active  row  is  redun¬ 
dant,  and  a  presolver  does  not  detect  the  redundancy,  the  only  negative  effect  is  increased 
solution  time.  But  in  other  cases,  always-active  rows  may  inflict  infeasibility  on  the  later 
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proximal  cascade  subproblems  because  their  inactive  columns  have  already  been  fixed  by 
earlier  subproblems.  This  could  occur  if,  for  example,  problem  S  above  has  only  one  feasi¬ 
ble  solution,  and  that  solution  includes  A  =  0,  and  B  —  d.  In  that  case,  a  cascade  that  fixes 
A  >  0  as  a  result  of  early  subproblems  will  culminate  with  an  infeasibility. 

Lagrangian  cascade  solutions  will  typically  have  better  quality  when  few  rows  are 
“always-active.”  A  proximal  cascade  row  that  is  always-active  must  be  “always  Lagrange- 
relaxed”  in  the  Lagrangian  cascade  to  preserve  the  Lagrangian  bound  for  the  monolith.  If 
optimal  Lagrange  penalties  are  not  known,  low  solution  quality  may  result. 

4.  Special  Conditions  in  the  First  and  Last  Subproblems 

Linear  programs  with  time,  priority  or  other  candidate  ordinal  cascade  index  set 
may  have  special  boundary  conditions,  such  as  specification  of  inventory  before  the  first  or 
after  the  last  period.  Consequently,  the  first  or  last  subproblem  may  have  umque  variable 
or  constraint  blocks  associated  with  these  boundary  conditions.  Although  starting  condi¬ 
tions  generally  do  not  affect  cascade  suitability,  ending  conditions  may  result  in  cascade 
infeasibility  due  to  myopia.  In  this  case,  a  model  reformulation  to  include  elastic  persis¬ 
tent  constraints  [Brown,  Dell,  and  Mbod,  forthcoming]  may  redress  the  infeasibility, 
suggest  this  approach  could  be  applied  to  a  proximal  cascade  in  a  production-scheduling 
LP,  for  example.  These  constraints  would  penalize  deviation  from  target  inventory  values 
at  the  end  of  each  subproblem.  The  target  values  would  be  specified  to  approach  over  time 
the  required  inventory  of  the  last  period,  which  is  strictly  enforced. 

The  gauges  developed  in  this  section  suggest  cascade  suitability  of  a  general  LP  by 
evaluating  three  pertinent  model  characteristics.  As  we  have  shown,  however,  caution  must 
be  taken  when  using  them. 

B.  WHEN  ARE  CASCADES  APPROPRIATE? 

Cascades  are  appropriate  if  monolith  structure  is  suitable  and  there  is  sufficient 
reason  to  warrant  any  loss  of  monolith  optimality.  The  following  sections  outline  three 
conditions  where  a  suitable  model  should  be  cascaded. 
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1. 


Cascades  used  with  Large  Problems 


We  use  cascades  of  large  problems  to  reduce  solution  time.  Empirically,  solution 
time  for  a  linear  program  increases  super-linearly  with  problem  size.  A  cascade  reduces 
solution  times  (thereby  allowing  larger  problems)  by  breaking  the  monolith  into  smaller 
subproblems.  The  cascade  implementation  of  NRMO  supports  this  conjecture.  When  the 
cascade  overlaps  are  small,  both  proximal  and  Lagrangian  cascades  are  solved  using  roughly 
the  same  time  required  by  the  monolith.  The  NRMO  tests  also  show  a  dramatic  time  sav¬ 
ings  when  each  subproblem  solves  using  only  installed  memory  and  the  monolith  solution 
requires  disk  “paging.”  In  this  czise,  the  combined  proximal  and  Lagrangian  cascades  solve 
in  much  less  time  than  the  monolith. 

2.  Cascades  to  Induce  Myopia 

Cascades  can  be  used  to  ensure  models  do  not  presume  knowledge  that  is  unavail¬ 
able  due  to  temporal,  spatial,  or  other  “remoteness,”  i.e.,  lack  of  proximity.  This  is  the  case 
with  NRMO,  which  models  a  myopic  scheduling  process.  Conversely,  enforcing  myopia 
without  a  cascade  is  very  tedious  for  any  moderately  sized  problem,  as  demonstrated  below. 

Consider  how  myopia  would  be  expressed  in  a  single  monolithic  linear  program. 
Primal  feasibility  is  enforced  for  all  the  constraints,  yet  dual  feasibility  and  complemen¬ 
tary  slackness  must  hold  for  each  myopic  solution  sub-horizon.  To  illustrate,  consider  a 
modification  of  problem  S: 


(5)  =  rQm^htXt 

t£T 

S.t.  ^  ^  CLtt'Xt'  ^  St  E  T 

t'€TSt 

Xt>0  'it  £T. 
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Problem  SCAS^  is  the  corresponding  proximal  cascade  formulation: 


(SC45”) 

n'  <n  t£TC^ 

s.t.  att’Xf  >  St  -  ^  att'X'^'  Vi  e  TCr 

feTStCtTC^  n'<nt'£TStnTF^' 

Xt>0  Vi  e  TC”. 


Consider  a  4-period  instance  of  S  with  a  single  period  overlap,  but  with  the  additional  stip¬ 
ulation  that  the  Xi  decision  be  made  prior  to  knowing  the  values  of  /14  and  S4.  A  proximal 
cascade  formulation  SCAS  easily  incorporates  this  situation: 


(SCAS^) 

min;<^  hiXi 

+/i2-^2 

A-h^Xs 

(VTi) 

s.t  ciiiXi 

> 

Si 

021X1 

H-a22-X^2 

> 

S2 

(W2) 

€[>32^2 

+0,33X3 

> 

S3 

(W3) 

Xi, 

X2, 

X3, 

> 

0 

(iS'C.^iS'^)  hiX}+  minx  ^12X2 

+^3-^3 

s.t  O22X2 

> 

S2  —  O21XI 

032X2 

-(-(233^3 

> 

S3 

<143 -^3 

+a44X4 

> 

^4 

X2, 

^3, 

^4, 

> 

0. 

An  equivalent  monolithic  formulation  that  formally  exhibits  “myopia”  has  to  satisfy 
both  the  dual  feasibility  and  complementary  slackness  conditions  of  SCAS  ^  in  addition  to 
the  original  constraints.  This  can  be  expressed  by  introducing  surplus  columns  R  and  slack 
columns  L  : 
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(M) 

nainx,i?,w,L  +/i2-X^2 

s.t  (ii\Xi 

^21-^1  +022-^2 
<132-^2 

diiWi 


RiWi  =  0 
LiXi  =  0 

Xi,...,X4>0, 


+/13X3 

-\-h4X4. 

-Ri 

= 

Si 

-R2 

= 

$2 

+<^33 -^3 

-Rs 

= 

53 

+<^43-^3 

H-a44J^4 

> 

S4 

+a2iM^2 

+Ll 

= 

hi 

CL22W2 

+C132W3 

+Z/2 

h2 

= 

hz 

R2W2  =  0  R3W5  =  0 
12X2  =  0  1-3X3  =  0 

Ri,R2,R3>0,  Li,L2,L3>0. 


(M.l) 


(M.2) 

(M.3) 

(M.4) 


Two  difficulties  arise  with  this  formulation,  foremost  being  tractability.  Constraint 
block  M.3  (complementary  slackness)  specifies  that  at  most  one  of  each  constraint’s  ele¬ 
ments  may  exist  in  the  solution  at  any  time.  This  represents  a  logical  condition  where  at 
most  one”  element  is  non-zero,  and  can  be  enforced  with  binary  auxiliary  variables  [e.g., 
Hillier  and  Lieberman,  1986,  p.  394].  Alternately,  this  condition  could  be  imposed  by  a 
complementary  pivoting  algorithm  [e.g,  Bazaraa,  Sherali,  and  Shetty  1993,  pp.  493-500], 
although  this  is  a  heuristic.  A  model  with  many  time  horizons  may  need  to  enforce  myopia 
for  each  horizon,  with  a  concomitant  increase  in  the  number  of  constraints. 

The  remaining  difficulty  with  the  above  formulation  is  that  it  still  doesn’t  completely 
enforce  myopia.  In  the  presence  of  multiple  optima,  the  dual  feasibility  and  complementary 
slackness  constraints  of  M  allow  selection  of  the  “best”  periods’  1 , 2,  and  3  decisions  with 
respect  to  period  4.  A  genuinely  myopic  formulation  selects  arbitrarily  among  the  first 
solution  horizon’s  multiple  optima,  because  it  has  no  foresight  that  allows  tie-breaking. 

The  literature  offers  no  other  method  of  enforcing  myopia  in  a  monolithic  formula¬ 
tion.  Cascades  appear  to  be  a  very  attractive  way  of  modeling  this  restriction. 
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3. 


Cascades  to  Isolate  Nearly  Independent  Subproblems 


Cascades  can  be  used  to  reduce  solution  time  when  independent,  or  at  least  not 
strongly  interdependent,  subproblems  can  be  isolated  and  solved  very  quickly.  Although 
solving  subproblems  for  this  purpose  is  not  the  focus  of  this  dissertation,  using  subproblems 
to  produce  a  crash  basis  remain  a  third  reason  to  cascade.  We  overview  this  strategy  here 
for  completeness. 

A  classic  example  of  isolating  nearly  independent  subproblems  is  the  multi-commod¬ 
ity  network,  with  lots  of  easy  network  subproblems  coupled  by  joint  capacity  constraints. 
Solving  each  network  subproblem,  ignoring  joint  capacitation  constraints,  and  then  using 
these  subproblem  solutions  to  give  an  advanced  starting  solution  for  the  monolith  may  solve 
the  monolith  much  faster  than  a  single  cold-start  solve  attempt  [e.g.,  Staniec  1987].  The 
CPLEX  solver  [1994,  pp.  33-35]  offers  an  option  to  solve  a  single  imbedded  pure  net¬ 
work  and  then  use  the  solution  to  crash  the  monolith.  Clearly,  the  advantage  of  such  an 
indirect  approach  is  enhanced  if  there  are  many  disjoint  subproblems  (for  example,  him- 
dreds  of  commodity  networks)  and  if  only  a  few  joint  commodity  capacitation  constraints 
are  actually  binding  at  optimality. 

Brown,  Graves,  and  Ronen  [1987]  use  cascades  to  solve  the  LP  relaxation  of  large 
set  partitions.  Here  the  cascade  index  set  is  not  deduced  from  any  model  indexing,  but  must 
be  determined  by  heuristic  topological  sorts  of  the  technological  coefficients.  Once  sorted, 
the  cascade  initially  restricts  each  subproblem  to  active  variables  with  non-zero  values  from 
prior  subproblem  solutions,  and  then  relaxes  to  all  active  variables.  The  authors  solve  larger 
and  larger  nested  subproblems  until  the  monolith  is  solved. 

C.  IMPROVING  CASCADES  WITH  DUAL  PRICES 

1.  Lagrangian  Penalties  for  Proximal  Cascades 

This  section  explores  how  subsequent  proximal  cascade  subproblems  may  exploit 
dual  information  from  previous  cascades  or  subproblems.  We  then  demonstrate  two  such 
methods  on  ten  small  staircase  problems. 
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Until  now,  dual  infonnation  from  a  proximal  cascade  provided  penalties  only  for 
the  Lagrangian  cascade.  However,  a  similar  idea  extends  to  a  proximal  cascade,  which  also 
relaxes  constraints.  In  the  case  of  time,  a  proximal  cascade  subproblem  relaxes  the  con¬ 
straints  of  “future”  periods,  i.e.,  the  set  of  periods  that  are  not  active  in  any  subproblem 
1, ...,  n.  Lagrangian  penalties  can  “charge”  active  columns  for  future  resource  usage,  trans¬ 
forming  relaxed  proximal  cascade  constraints  to  Lagrange-relaxed  constraints.  This  is  sim¬ 
ilar  to  the  Lagrangian  cascade,  except  Lagrangian  subproblems  incorporate  penalties  from 
both  prior  and  future  constraints.  A  proximal  cascade  explicitly  enforces  all  constraints  by 
sending  fixed  primal  columns  forward  to  the  next  subproblem.  This  is  necessary  because 
even  optimal  Lagrangian  penalties  do  not  guarantee  that  relaxed  constraints  are  satisfied. 
The  Lagrangian  cascade  is  not  explicitly  altered,  although  any  improvement  in  the  prox¬ 
imal  cascade  solution  quality  will  be  reflected  in  the  associated  duals,  and  therefore  the 
Lagrangian  cascade. 

To  illustrate,  consider  a  modification  of  problem  SCAS'^  for  some  —  ^  ' 

n^<nt£'rF^'  lastp^  <t<t-h7n  \  t'eTStOTC^ 

s.t.  ^  att'Xf  >  St-  E  E  att'X^'  Vi  G  TCr 

t'erStOTC”  n'<nt>£TStnTF'^' 

Xt>0  vt  €  TO”. 

The  additional  objective  term  does  not  provide  a  straightforward  Lagrangian  relaxation, 
since  it  only  includes  active  columns,  rather  than  all  columns  from  the  original  row.  How¬ 
ever,  the  formulation  makes  clear  the  intention  to  reward  satisfaction  of  rows  in  subproblem 
n  -h  1  by  columns  in  subproblem  n.  By  ignoring  the  constant  term,  the  desired  formulation 
is 


{SL^)  htXf +  tmn  htXt-  X!  ®**'^*' 

n'<nt£TF’^'  t^TC^  lastp”-<t<t+m  t'eTStCTC^ 


.t.  ^  ott'Xf  >  St  -  ^  ^  att'Xti  Vt  e  TCT^ 

t'eTStnrC"  n'<nt'^TStr\TF"' 

Xt>o  vt  G  Tcr. 
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Assuming  exists  only  for  i  e  T,  the  proximal  cascade  solution  value  remains  unmodified: 


rN 


=  E  E 


nSJVC  teTF" 

This  formulation  not  only  enforces  feasibility  of  active  rows,  but  encourages  satis¬ 
faction  of  future  subproblem  rows  through  the  use  of  some  /?<  >  0.  Grinold  [1983]  intro¬ 
duces  a  similar  technique  for  infinite  horizon  programming,  although  his  formulation  also 


accomts  for  the  contribution  of  inactive  columns,  and  retains  the  constant  term  as  a  measure 


of  “salvage.” 

The  Lagrangian  penalty  formulation  requires  exogenous  specification  of  the  La¬ 
grange  multiplier,  /3f  How  one  selects  a  proper  value  depends  on  the  underlying  motivation 
for  the  cascade.  If  omniscience  is  acceptable  and  multiple  series  of  cascades  (proximal  and 
Lagrangian  cascades  performed  more  than  once)  can  be  made,  the  multipliers  for  a  subprob¬ 
lem  can  be  taken  from  the  corresponding  constraints  of  an  earlier  solution  of  the  same  sub¬ 
problem.  Each  subproblem  receives  prices  from  future  periods  of  the  previous  series,  and 
re-sol ves  based  on  those  prices.  On  the  other  hand,  if  myopia  must  be  enforced,  multipli¬ 
ers  are  passed  forward  from  “similar”  constraints  of  previous  subproblems.  Computational 
results  using  each  of  these  strategies  are  discussed  next. 


a.  Iterated  Lagrange  Multipliers 

Iterated  Lagrange  multipliers  derive  Lagrangian  penalties  from  the  previ¬ 
ous  cascade  series.  In  tests  described  in  this  section,  these  series  are  run  until  no  further 

improvement  in  solution  quality  occurs. 

Instances  of  model  S  with  20  periods  and  varying  staircase  overlaps  m  pro¬ 
vide  a  test  case  for  Iterated  Lagrange  multipliers.  Problem  S  is  reformulated  into  subprob¬ 
lems  of  the  form  SI".  The  test  considers  10  different  sets  of  overlap  and  cascade  para¬ 
meters.  The  penalties  {Pt)  for  Lagrange-relaxed  constraints  in  the  proximal  cascade  come 
from  the  previous  series;  the  initial  series  of  each  set  uses  ^^  =  0.  Subsequent  series  penal¬ 
ties  derive  from  the  last  subproblem  in  which  the  corresponding  constraints  are  active.  The 
Lagrangian  cascade  selects  penalties  from  the  most  recent  proximal  cascade  subproblem  in 
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which  the  corresponding  constraints  are  active.  Table  6  describes  the  results. 


Set# 

m 

caswid 

V 

Iwid 

Series  1 

%  gap 

Series  2 

%  gap 

Series  3 

%  gap 

Series  4 

%  gap 

1 

1 

4 

3 

5 

7,0 

2,0 

2,0 

.2 

2 

1 

5 

2 

5 

10.7 

- 

- 

- 

3 

1 

7 

2 

7 

11.5 

1.7 

2.0 

0 

4 

2 

5 

4 

5 

23.2 

« 

- 

- 

5 

2 

6 

2 

5 

22.4 

15.2 

- 

- 

6 

2 

6 

4 

5 

21.5 

15.6 

1,0 

- 

7 

2 

6 

5 

5 

21.2 

13.9 

0 

8 

2 

7 

4 

7 

13.2 

8.8 

- 

- 

9 

2 

10 

2 

10 

13.8 

0 

10 

2 

10 

4 

10 

5,7 

1.3 

0 

Table  6.  Sets  of  cascade  SL  use  various  widths  and  overlaps  to  test  iterated  Lagrange  multipliers.  In  this  test,  each  pair  of 
proximal  and  Lagrangian  cascades  forms  a  series.  The  multipliers  for  proximal  cascade  Lagrange-relaxed  constraints  in 
each  subproblcm  come  from  the  previous  series.  The  initial  series’  multipliers  are  0.  Each  subsequent  series  multiplier 
comes  from  the  last  subproblem  in  which  the  corresponding  constraint  is  active.  The  Lagrangian  cascade  selects  a  multi¬ 
plier  from  the  most  recent  proximal  cascade  subproblem  in  which  the  corresponding  constraint  is  active.  For  instance,  Set 
#6  has  staircase  overlap  2,  proximal  cascade  width  6,  proximal  cascade  overlap  4,  and  Lagrangian  cascade  width  5.  The 
series  1  gap  of  21.5%  reflects  no  dual  information.  The  series  2  and  3  gaps  of  15.6%  and  1.0%,  respectively  reflect  new 
and  more  accurate  multipliers.  A  series  entry  indicates  that  the  gap  oscillates  back  to  a  previous  value,  and  no  fur¬ 
ther  improvement  occurs.  The  results  show  significant  gap  improvement  in  all  but  sets  2  and  4.  The  mean  gap  is  reduced 
from  15,0%  to  5.9%. 

These  results  show  that  information  regarding  future  constraints  reduces  the 
average  proximal-Lagrangian  gap  from  15.0%  to  5.9%.  The  gap  is  reduced  in  8  of  10  sets. 

Incorporating  penalties  in  the  proximal  cascade  objective  improves  the  La¬ 
grangian  cascade  queility  as  well.  Averaged  over  the  10  sets,  the  Lagrangian  cascade  solu¬ 
tion  values  account  for  53%  of  the  total  gap  reduction,  proximal  cascades  account  for  the 
remaining  47%. 

Iterated  Lagrange  multipliers  provide  encouraging  results,  but  require  mul¬ 
tiple  series  of  cascades  that  “look  into  the  future.”  Consequently,  any  improved  solution 
quality  requires  more  computation  and  omniscience. 
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b.  Forward  Pass  Multipliers 

We  can  pass  forward  dual  multipliers  from  prior  subproblems  in  a  proximal 
cascade  without  violating  myopia.  Myopia  does  not  preclude  incorporating  past  informa¬ 
tion  to  better  accommodate  the  future.  To  the  extent  that  constraints  have  homogeneous 
structure  from  period  to  period,  Lagrange  multipliers  from  previous  subproblems  may  ap¬ 
proximate  resource  consumption  penalties  of  future  periods. 

We  use  cascade  SL  to  demonstrate  forward  pass  multipliers  since  it  has  a 
homogeneous  structure.  In  this  test,  each  penalty  passed  to  subproblem  n  -t- 1  is  the  mean 
of  the  optimal  multipliers  from  the  staircase  constraints  of  the  last  m  periods  in  subproblem 
n.  For  example,  if  the  active  periods  of  subproblem  1  are  1  through  10,  and  the  staircase 
overlap  is  2,  the  multipliers  passed  forward  to  subproblem  2  are  the  average  of  the  optimal 
staircase  duals  from  periods  9  and  10. 


Set# 

Unaltered 

%  gap 

Forward  Pass 

Multipliers  %  gap 

1 

7.0 

6.8 

2 

10.7 

10.7 

3 

11.5 

11.5 

4 

23.2 

12.9 

5 

22.4 

37.6 

6 

21.5 

21.1 

7 

21.2 

21.2 

8 

13.2 

2.7 

9 

13.8 

7.9 

10 

5.7 

3.8 

Table  7.  Sets  of  cascade  SL  use  various  widths  and  overlaps  to  VtA  forward  pass  multipliers.  Using  the  same  widths  and 
overlaps  as  Table  6,  sets  1  through  10  are  used  to  test  a  single  cascade  series  with  dual  penalties  passed  forward  from 
each  proximal  cascade  subproblem  to  its  successor.  Each  penalty  passed  to  subproblem  n  + 1  is  the  mean  of  the  optimal 
multipliers  from  constraints  of  the  last  m  periods  in  subproblem  n.  Myopia  is  not  violated,  since  only  historical  resource 
prices  are  used  to  predict  the  future.  For  instance,  the  gap  from  set  #4  without  passing  forward  multipliers  is  23.2%.  The 
gap  improves  to  12.9%  when  multipliers  are  passed  forward.  Only  set  5  produces  a  larger  gap,  and  the  average  gap  is 
reduced  from  15.0%  to  13.6%. 


Table  7  describes  the  results  of  this  test  using  the  same  sets  from  Table  6. 
The  percentage  gaps  shown  are  with  and  without  forward  pass  multipliers. 
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Incorporating  forward  pass  multipliers  yields  the  same  or  smaller  gap  in  9 
out  of  10  sets.  This  result  is  not  surprising.  Rather  than  simply  ignoring  the  restrictions 
imposed  by  the  future,  the  model  predicts  the  future  based  on  an  average  assessment  of  the 
past. 

As  with  iterated  Lagrange  multipliers,  over  half  of  the  forward  pass  multi¬ 
pliers  gap  improvement  results  from  better  dual  information  strengthening  the  Lagrangian 
bound.  On  average,  62%  of  the  average  gap  reduction  comes  from  the  Lagrangian  cascade; 
38%  comes  from  proximal  cascade  improvement. 

Passing  forward  average  values  is  imprecise;  performance  can  be  improved 
considerably  given  any  underlying  knowledge  of  which  past  constraints  are  similar  to  future 
constraints.  For  example,  the  relative  value  of  resources  A  and  B  often  remains  similar 
across  time.  Averaging  the  two  values  of  subproblem  n’s  marginal  cost  for  A  and  B  makes 
little  sense  when  forecasting  subproblem  n  +  I’s  penalties.  Cyclical  similarity  also  might 
occur  in  a  model  that,  for  example,  has  a  cascade  index  set  covering  many  weeks  in  daily 
time  increments.  In  this  situation,  last  Friday’s  multipliers  might  provide  a  better  forecast 
for  next  Friday  than  an  average  of  last  Thursday’s,  and  Friday’s,  and  Saturday’s  multipliers. 
Perhaps  an  idea  as  simple  as  exponential  moving  average  duals  would  capture  the  sense  of 
proximity  using  cascades.  Applying  this  technique  is  model  specific,  and  presents  a  topic 
for  future  research. 

2.  Explicitly  Improving  Lagrangian  Cascades 

Just  as  traditional  Lagrange  multiplier  search  methods  tighten  the  boimd  provided 
by  Lagrangian  relaxation  [e.g.^  Parker  and  Rardin,  pp,  212-237],  a  Lagrangian  cascade  also 
benefits  from  improved  multipliers.  The  iterated  Lagrange  multipliers  method  provides  an 
opportunity  for  a  multiplier  search  after  each  series.  However,  search  methods  are  com¬ 
putationally  expensive,  so  providing  this  feedback  may  lengthen  the  series  considerably. 
Since  the  iterated  Lagrange  multipliers  method  already  updates  multipliers  from  series-to- 
series  and  improves  the  Lagrangian  bound  as  a  result,  the  extra  effort  may  not  be  warranted. 
Nonetheless,  it  remains  an  area  for  future  research. 
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D.  A  CASCADING  \ARIATION  OF  BENDERS’  DECOMPOSITION 


In  this  section,  we  show  that  cascade  solution  quality  improves  significantly  on  test 
problems  using  a  strategy  that  adds  cuts  from  previous  cascade  series.  These  cuts,  although 
weak,  yield  problem  S  solution  values  within  a  few  percent  of  monolith  optimal  after  several 
series.  This  approach  is  a  heuristic  variation  of  Benders’  decomposition  [Benders  1962]. 

The  2-stage  Benders’  decomposition  of  Van  Slyke  and  Wets  [1969],  and  its  multi¬ 
stage  extension  by  Birge  [1985]  successively  add  cuts  that  support  the  (convex)  Lagrangian 
dual  function.  Using  a  variation  of  this  approach  in  concert  with  the  iterated  Lagrange 
multiplier  technique,  we  attain  a  tighter  gap  between  the  proximal  and  Lagrangian  cascade 

solutions  on  10  simple  staircase  problems. 

In  order  to  demonstrate  how  Benders’  cuts  can  be  incorporated  into  a  proximal  cas¬ 
cade,  define  TE"  =  {f  :  t  >lastp^}  as  the  future  periods  (the  set  of  periods  that  are  not 
active  in  subproblems  1, ...,  n).  Problem  BCAS'^  is  the  solution  to  the  remaining  periods, 
given  the  fixed  columns  of  subproblems  l,...,n  —  1.  In  other  words,  BCAS^  provides  the 
solution  to  the  remaining  monolith,  given  the  cascade  solution  for  t  €  • 


(BCAS^) 


E  hfXf  -h  n^  E  htXt  -1-  E  hfXt 


teTC^ 


teTB^ 


s.t.  Yi  "‘-E  E  (.BCAS.I) 

t^eTStOTC^  Ti'<n  t'GTStnTF^' 

(Ht'Xf  >  St-  E  ott'Xv  Vt  e  TET- 

t'srStDTf;"  t'sTStnTC" 

Xt  >  0  Vt  €  T(T  U  TE^. 

Taking  the  dual  of  the  rows  and  columns  indexed  by  f  eTE  "  yields: 

E"  =  V  V  htXf  -t-  min  V  htXt  +  m^  ~  ) 

^  tsTC”-  t^TE”  \  t'eTStnTC^  / 


n'<n  t&TF^'  t^TC” 

S.t.  (BCAS.I), 

Xt>0  ^teTC^  /5t>0  ^teTET. 


(BCn.l) 
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Figure  12.  This  figure  illustrates  the  terms  of  a  dualized  constraint  from  problem  BCAS^,  which  represents  the  remaining 
monolith  given  the  solution  to  subproblems  1, n  —  1.  The  periods  of  BCAS^  are  partitioned  into  sets  TC^  and  TE^. 
TC  has  the  same  width  as  all  previous  subproblems;  TE ""  consists  of  all  the  future  periods.  In  the  example,  the  last  period 
of  TC  is  10,  the  first  period  of  ”  is  1 1 ,  and  the  constraint  overlap  m  is  2.  When  rows  indexed  by  TE  are  dualized,  the 
left-hand-side  terms  in  the  row  indexed  by  period  11  bic  and /S^gaia.i!,  or 


Refer  to  Figure  12  for  an  illustration  that  describes  why  the  left-hand-side  terms  in  equation 
BCn.l  are  all  indexed  by  t  eTE^. 

Proceeding  with  the  Benders’  decomposition,  the  above  formulation  is  equivalent 
to 

™  htXt  +  max  Y.  “**'^*' 

n'<nt^TF”-'  t^TC^  '  fGTB"  \  t’eTStHTC"- 

s.t.  (BCAS.l) 

Xt>0  Vt  G  TC". 
where  is  a  component  of  vector  G  B,  the  set  of  extreme  points  defined  by  the 


region: 


Y  Pt'at't<ht  'iteTE^ 

t':t€TS^i 

A  >  0  e 


(for  simplicity,  and  to  avoid  the  need  for  feasibility  cuts,  we  assume  that  the  feasible  region 
in  this  problem  is  a  bounded  polytope  [e.g.,  Parker  and  Rardin,  1988,  pp.237-244]).  Thus, 
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cascade  BCAS'^  may  be  rewritten  as 


z”  =  E  E 

n'<n  teTF’'' 


+  min 

x,9 


htXt  +  r 

teTC”- 


s.t.  (BCAS.l) 


(BCAS.2) 


Xt>0  Vt  €  Tcr. 


Each  of  these  proximal  cascade  subproblems  serves  as  the  master  problem  for  its 
successor  and  the  subproblem  of  its  predecessor.  The  Benders’  subproblem  consists  of  de¬ 
riving  additional  cuts  of  the  form  given  by  BCAS  .2.  A  subset  of  these  constraints  approxi¬ 
mates  BCAS'^,  which  is  an  approximation  of  the  monolith  when  n  =  1. 

Cut  generation  for  BCAS^  is  done  by  BCAS^"^^.  Unfortunately,  instead  of  the  sub¬ 
problem  implied  by  BCAS  .2,  the  available  subproblem  provided  by  is 


Y  htXf+n^  Y  htXt  +  n^  Y 

n'<n+lt^TF^'  terC"+i  t&TE^+^ 

s.t.  E  E  E 

t'€TStnTC"+i  n'<n+l  t'eTStOTF™' 

Y  o.tt'Xt'  >  St-  E  att>Xv  vt  e 

t'€TStnT£;"+i  t'eTStOTC^+i 

At  >  0  vt  e  u  . 


Taking  the  dual  of  BCAS  yields 
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z"=  E  x; 

n'<n+l  teTF^' 

+  inax  52  ^t'X^' 

tGTC+i  \  n'<n-\-ltf^'rStr\TF^' 

s.t.  ^  Pt'(^t’t<ht  (BCn+1.1) 

t':teTS^i 

Pt'<h't<ht  ^teTE'^+\  (BCn+1.2) 

t'-.teTSii 


Because  of  the  cascade  overlap,  EE”  7^rC”+^urE"'*'^  Consequently,  the  subproblem  ex¬ 
treme  points  required  by  BCAS^  are  defined  by  BCn.l,  while  the  subproblem  extreme 
points  of  5C45”+^  are  defined  by  BCn+1.1  and  BCn+1.2.  Thus,  the  extreme  points 
b(0  e  B  required  by  BCAS"'  are  not  the  same  as  the  extreme  points  provided  by  the  dual 
of  BCAS^^^.  However,  only  the  cascade  overlap  distinguishes  the  two  feasible  regions, 
which  suggests  the  two  regions  share  many  similarities. 

The  first  series  of  the  cascading  variation  of  Benders’  decomposition  solves  sub¬ 
problems  BCAS  ^  ,BCAS  ^  .  ,BCAS  ^ ,  without  any  cuts.  Subsequent  series  solve  these  sub¬ 
problems  in  the  same  order  using  the  heuristic  cuts  generated  by  the  dual  variables  from 
BCn +1.1  and  BCn+1.2  of  all  previous  series.  Each  series  includes  one  additional  cut  per 
subproblem.  The  proximal  cascade  solution  value  is  the  objective  value  of  the  last  subprob¬ 
lem  of  the  most  recent  series,  since  TE  ^  0.  A  Lagrangian  cascade  uses  the  dual  variables 
supplied  by  the  most  recent  proximal  cascade. 

Table  8  gives  results  for  test  sets  1  through  10.  In  general,  the  method  does  not 
converge  to  monolith  optimal,  but  stabilizes  consistently  within  a  few  percent  in  all  of  these 
examples.  As  with  iterated  Lagrange  multipliers  and  forward  pass  multipliers,  over  half 
(60%)  of  the  gap  reduction  is  attributable  to  the  Lagrangian  cascade,  which  reflects  the 
benefit  of  more  accurate  Lagrangian  penalties. 

These  results  suggest  a  promising  alternative  to  Lagrangian  methods  of  passing  dual 
information  within  the  proximal  cascade  (although  this  method  should  not  be  used  when  en¬ 
forcing  myopia).  Unlike  traditional  nested  decomposition  for  staircase  models,  the  cascad- 
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Set# 

Benders’  Series 

Unaltered 

Iterated  Lagrange 

Benders’ 

until  Stable 

%  gap 

Multipliers  %  gap 

%  gap 

1 

13 

7.0 

.2 

0 

2 

10 

10.7 

10.7 

7.2 

3 

2 

11.5 

0 

1.7 

4 

9 

23.2 

23.2 

6.5 

5 

3 

22.4 

15.2 

4.0 

6 

4 

21.5 

1.0 

3.3 

7 

4 

21.2 

0 

3.3 

8 

3 

13.2 

8,8 

1.3 

9 

2 

bo 

0 

0 

10 

3 

5.7 

0 

0 

Table  8.  Sets  of  cascade  BCAS  use  the  same  widths  and  overlaps  as  in  Table  6  to  test  the  cascading  variation  of  Benders 
decomposition.  Each  Benders’  series  includes  one  more  dual  cut  in  the  proximal  cascade  than  the  previous  series.  By 
retaining  old  cuts,  this  method  is  more  effective  at  gap  reduction  than  unaltered  or  iterated  Lagrange  multipliers  methods. 
For  example,  set  #8  requires  3  Benders’  series  to  stabilize  at  a  gap  of  1.3%.  In  contrast,  the  unaltered  cascade  produces 
a  gap  of  13.2%,  while  the  iterated  Lagrange  multipliers  cascade  has  a  gap  of  8.8%.  The  Benders’  gap  is  always  less  than 
the  unaltered  gap,  but  is  slightiy  larger  than  the  iterated  Lagrange  multipliers  gap  in  sets  3, 6,  and  7.  The  average  Benders’ 
gap  is  2.7%,  while  the  unaltered  and  iterated  Benders’  gaps  are  15.0%  and  5.9%,  respectively.  Additionally,  the  Benders’ 
approach  typically  yields  gaps  within  a  few  percent,  while  the  iterated  Lagrange  multipliers  gaps  are  more  erratic. 

ing  variation  of  Benders’  lacks  a  convergence  proof.  However,  traditional  nested  decompo¬ 
sitions  have  no  cascade  overlap,  and  must  enforce  rows  with  fixed  column  levels  at  the  risk 
of  infeasibility.  Thus,  the  cascading  variation  of  Benders’  decomposition  has  an  advantage 
over  many  nested  formulations,  which  must  add  cuts  until  convergence  is  obtained. 

E.  CASCADES  WITH  FIXED  FUTURE  PRIMALS 

Wfe  improve  solution  quality  on  test  problems  by  fixing  all  inactive  columns  at  their 
last  computed  level,  either  from  a  (previous)  proximal  cascade  subproblem  of  the  current 
series,  or  from  a  proximal  cascade  subproblem  of  the  previous  series.  The  fixed  Juture 
primals  method  is  unlike  other  cascade  strategies  in  this  research  because  those  strategies 
all  fix  future  columns  at  zero.  Fixing  future  primal  columns  based  on  previous  series  is  not 
myopic,  and  it  may  offer  considerable  improvement  in  solution  quality. 

Piljnal  variables  indexed  by  t  >  Zastp”  do  not  influence  cascade  subproblem  S'C!/4iS  , 

since  a  row’s  cascade  index  is  never  exceeded  by  any  associated  column’s  cascade  index.  In 
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order  to  incorporate  an  influence  of  future  columns,  we  define  set 
TV^  =  {t  :  lastp"'  <t<  /astp”  +  m}  as  the  set  offatureperiodsjust  outside  the  active  in¬ 
dex  set.  Now  consider  subproblem  SF  ”  which  activates  all  rows  associated  with  any  active 
column: 


{SF^)  ^”  =  5^  htXf  +vsmi  53  htXt 

n'<n 

s.t.  53  o,tt'Xt>  >  St  —  53  53  ^tt'X^,  Vt  G  TC"  {SFl) 

t'QTStOiTC^  n'<nt'iTStr\TF^' 

53  au'Xt>>  St-  ^  Ott'Xf  yteTU^  (SF2) 

t'eTSt^TC”’  t'^TStC\TU”- 

Xt  >  0  vt  G  Tcr. 


Here,  Xt  is  the  last  value  computed  for  a  column  from  a  cascade  of  the  previous  series. 
Xt  =  0  Vt  in  the  first  series. 

The  fixed  future  primals  method  is  appealing  because  it  may  increase  solution  qual¬ 
ity  with  only  a  minor  formulation  change,  but  this  change  may  have  disadvantages.  For 
example,  including  constraint  SE2  in  the  formulation  may  produce  infeasibility  when  the 
constraints  represent  balance  of  flows,  particularly  in  the  first  series  when  Xj  =  0.  This  dif¬ 
ficulty  motivated  the  discussion  in  Chapter  II,  Section  B.2,  and  precipitated  leaving  these 
rows  inactive  for  other  cascade  descriptions. 

Constraint  SF2  also  increases  the  number  of  rows  in  each  subproblem  without  guar¬ 
anteeing  improvement  of  the  solution  quality.  Consider  this  simple  example: 

min  4Xi  -1-2X2  +-^3 
s.t.  10X1  -I-X2  ^  2 

+X2  X3  >  2 

Xi,  X2,  X3  >  0. 

A  solution  to  this  problem  is:  X^  =  .2,  X3  =  2,  with  Z*  =  2.8.  Now  consider  a  cascade 
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with  two  subproblems: 


min  AX\ 

+2X2 

Xi^+  min 

2X2 

+X3 

s.t.  lOXi 

+X2 

> 

2  s.t. 

X2 

> 

2  -  lOX^ 

X2 

> 

2 

X2 

+X3 

> 

2 

^1, 

X2, 

> 

0 

X2, 

X3 

> 

0 

= 

4 

Z^  = 

4 

XI  = 

0 

X|  = 

2 

XI  ^ 

2 

^1= 

0. 

Since  Xf  =  0,  subsequent  series 

will  generate  the 

same  solution  and  no  improvement  in 

solution  quality  can  result 

Although  it  does  not  guarantee  better  solution  quality,  the  fixed  future  primals  method 
works  well  in  test  sets.  Table  9  compares  fixed  future  primals  with  the  Benders  method 
of  the  last  section.  The  two  methods  offer  similar  results,  although  the  Benders  method 
consistently  yields  gaps  under  10%,  while  fixed  future  primals  gaps  are  more  erratic. 

Fixed  future  primals  offer  another  method  to  improve  solution  quality  when  myopia 
is  not  required.  As  with  iterated  dual  multipliers  and  the  cascading  variation  of  Benders 
decomposition,  fixed  future  primals  require  multiple  cascade  series.  This  method  is  simpler 
to  implement  than  adding  Benders’  cuts,  although  subproblem  infeasibility  is  more  likely 
due  to  the  increased  number  of  constraints  with  inactive  associated  columns.  The  resulting 
gaps  are  smaller  than  wdth  the  Lagrangian  penalty  method,  but  larger  than  the  gaps  obtained 
with  the  Benders’  method. 

E  SUMMARY 

Cascades  often  provide  a  useful  alternative  to  actually  solving  a  linear  programming 
monolith.  Linear  programs  with  constraints  that  C2in  be  re-ordered  into  a  staircase  are  usu¬ 
ally  suitable  for  cascading.  The  casfactorx^  allact  x  gauges  provide  an  indication 

of  cascade  suitability,  although  some  formulations  complicate  their  effectiveness. 

A  suitable  model  warrants  cascading  if  the  monolith  is  too  large  to  solve,  or  if  the 
model  requires  myopic  solution,  or  if  we  can  isolate  “easy”  subproblems  that  facilitate  rapid 
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Benders’ 

Primal 

Primal 

Primal 

Primal 

Primal 

Series  5 

Primal 

Series  6 

Set# 

Series  1 

Series  2 

Series  3 

Series  4 

%  gap 

%  gap 

%  gap 

%  gap 

%  gap 

%  gap 

%  gap 

1 

0 

7.0 

.6 

0 

2 

7.2 

12.9 

7.4 

5.1 

4.0 

2.7 

- 

3 

1.7 

10.6 

7.8 

- 

- 

- 

- 

4 

6.5 

8.2 

4.7 

- 

- 

- 

- 

5 

4.0 

18.5 

12.5 

- 

- 

- 

- 

6 

3.3 

27.7 

.3 

0 

7 

3.3 

46.0 

4.6 

3.3 

- 

- 

- 

8 

1.3 

5.5 

5.5 

2.3 

1.3 

0 

9 

0 

13.8 

12.4 

- 

- 

- 

- 

10 

0 

5.6 

1.3 

- 

- 

- 

- 

Table  9.  Sets  of  cascade  SF  use  various  widths  and  overlaps  to  compare  fixed  future  primals  with  the  cascading  variation 
of  Benders’  decomposition.  In  the  primal  method,  each  proximal  cascade  subproblem  incorporates  columns  fixed  in  the 
previous  series  to  estimate  future  columns  in  the  current  series,  therereby  reducing  myopia.  We  terminate  each  set  when 
a  series  yields  a  gap  of  zero,  or  when  no  further  gap  reduction  occurs.  For  instance.  Set  #6  has  a  Benders’  gap  of  3.3%. 
The  first  fixed  future  primals  series  uses  future  column  levels  fixed  at  0,  and  yields  a  gap  of  27.7%.  Subsequent  fixed 
future  primals  gaps  for  set  #6  are  .3%,  and  0%.  A  series  entry  indicates  that  no  further  gap  improvement  occurs. 
Fixed  future  primals  yield  better  solution  quality  than  Lagrangian  penalty  methods,  although  the  solution  qualties  are  not, 
on  average,  as  good  as  the  Benders’  solution  qualities.  The  average  fixed  future  primals  gap  is  4.5%,  and  the  average 
Benders’  gap  is  2.7%. 

monolith  solution.  Cascades  are  a  viable  alternative  to  attempting  an  outright  monolith 
solution  in  any  of  these  situations. 

Finally,  incorporating  dual,  or  additional  primal  information  in  a  proximal  cascade 
reduces  the  proximal-Lagrangian  gap.  Forward  pass  multipliers  preserve  myopia  by  incor¬ 
porating  dual  information  from  Structurally  similar  constraints  of  previous  subproblems. 
Other  methods  require  multiple  cascade  series.  The  iterated  Lagrange  multipliers  method, 
fixed  future  primals  method,  and  the  cascading  variation  of  Benders’  decomposition  all 
violate  myopia,  but  provide  more  gap  reduction  than  a  myopic  cascade. 
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VI.  SUMMARY  AND  RECOMMENDATIONS 


This  dissertation  develops  a  proximal  cascade  heuristic  to  approximate  solutions  of 
large  linear  programs,  and  a  Lagrangian  cascade  to  bound  the  error  incurred  by  that  ap¬ 
proximation.  NRMO  demonstrates  the  usefulness  of  cascades  on  a  large,  time-based  linear 
program.  This  model  has  the  staircase  structure  conducive  to  cascades,  but  also  includes 
numerous  complexities  that  allow  us  to  illustrate  the  flexibility  of  cascades.  This  disser¬ 
tation  also  examines  the  applicability  of  cascades  to  more  general  models,  and  presents 
enhancements  that  reduce  the  proximal-Lagrangian  gap. 

A.  CONTRIBUTIONS 

1.  Lai^e-Scale  Mathematical  Programming 

There  are  several  contributions  to  the  solution  techniques  for  large-scale  optimiza¬ 
tion  models  presented  in  this  research.  First,  we  formalize  the  proximal  cascade  heuristic, 
and  present  results  that  relate  the  cascade  solution  value  to  the  monolith  solution  value  for 
staircase  linear  programs.  Although  we  present  the  results  in  the  context  of  elastic-demand 
staircase  LPs,  they  are  directly  applicable  to  more  general  staircase  models.  Additionally, 
we  develop  optimistic  bounds  on  the  monolith  solution  value  using  a  proximal  cascade  for 
a  specific  class  of  problems. 

This  research  also  introduces  and  develops  the  Lagrangian  cascade.  Using  dual 
prices  from  the  proximal  cascade,  a  Lagrangian  cascade  serves  as  a  super-optimal  bound 
on  the  monolith  solution  to  any  staircase  model.  Previously,  no  technique  existed  to  evaluate 
how  close  the  proximal  cascade  solution  value  might  be  to  the  monolith  solution  value.  We 
strengthen  the  Lagrangian  cascade  bound  by  the  introduction  of  extended  constraints  and 
duplicate  variables.  This  technique  is  generalizable  to  any  Lagrangian  relaxation. 

We  extend  the  theory  of  proximal  cascades  to  utilize  dual  as  well  as  primal  vari¬ 
ables  in  subsequent  cascades  or  subproblems.  The  fixed  future  primals  method  improves 
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solution  quality  by  fixing  the  future  columns  of  the  subproblems  at  their  last  computed  val¬ 
ues.  Dual  iniormation  can  improve  the  cascade  solution  quality  by  rewarding  satisfaction  of 
constraints  that  are  explicitly  enforced  in  later  subproblems.  There  are  three  specific  dual 
techniques,  including:  1)  iterated  Lagrange  multipliers,  which  use  duals  from  the  corre¬ 
sponding  constraints  of  previous  cascade  series,  2)  forward  pass  multipliers,  which  forecast 
future  dual  prices  using  a  previous  subproblem,  and  3)  a  cascading  variation  of  Benders 
decomposition,  which  adds  successive  dual  cuts  to  each  subproblem. 

2.  Air  MobUity  Optimization 

This  research  describes  a  large-scale  optimization  model  to  enhance  DOD’s  mobil¬ 
ity  analysis  capability.  NRMO,  jointly  developed  with  Rosenthal,  Morton,  and  Melody,  is 
the  most  detailed  optimization  model  of  USAF  air  mobility  assets  ever  developed.  It  is  cur¬ 
rently  in  use  by  the  RAND  Corporation,  has  been  accepted  by  the  Air  Force  Studies  and 
Analyses  Agency,  and  is  being  evaluated  by  Headquarters,  Air  Mobility  Command  for  use 
in  forthcoming  studies. 

Cascades  alleviate  the  primary  concern  in  the  mobility  analysis  community  that  an 
instance  of  a  NRMO  model,  large  enough  to  capture  adequate  detail,  is  too  large  to  solve. 
Cascading  reduces  NRMO  solution  times  by  as  much  as  80%  when  available  memory  is  lim¬ 
ited.  Cascades  also  eliminate  the  secondary  concern  that  optimizing  the  air  mobility  system 
erroneously  assumes  perfect  scheduling  foresight,  although  the  actual  system  is  myopic. 
Furthermore,  this  dissertation  demonstrates  the  availability  of  optimistic  boimds  that  are 
used  to  examine  the  cost  of  myopic  scheduling. 

B.  RECOMMENDATIONS  FOR  FUTURE  RESEARCH 

suggest  some  interesting  enhancements  to  cascades  for  further  study. 

•  A  cascade  of  integer  programs  is  mentioned  in  this  research  but  not  developed. 
Although  the  proximal  cascade  results  apply  directly  to  integer  programs,  the 
Lagrangian  cascade  results  do  not.  Lagrangian  relaxations  of  integer  programs 
may  exhibit  an  integrality  gap,  since  even  optimal  dual  multipliers  do  not  neces¬ 
sarily  provide  a  tight  bound.  Non-optimal  multipliers  from  a  proximal  cascade 
will  generally  degrade  this  gap  even  further.  Additionally,  a  Lagrangian  cascade 
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requires  meaningful  dual  information  from  the  proximal  cascade.  Meaningful 
duals  may  not  be  available  when  the  proximal  cascade  includes  integer  restric¬ 
tions. 

•  A  cascade  subproblem’s  first  and  last  periods  in  this  research  are  set  at  regular 
intervals.  Model  structure  may  suggest  alternate  “boundaries”  where  the  model 
is  weakly  linked.  Exploiting  this  information  a  priori  could  increase  cascade 
solution  quality,  but  appears  to  be  very  model  specific  and  difficult  to  predict  in 
general. 

•  Penalties  taken  from  previous  proximal  cascade  subproblems  and  applied  to  the 
active  subproblem  are  approximated  crudely  in  this  research.  When  possible, 
penalties  should  be  chosen  to  exploit  suspected  similarities  between  previously 
constrained  resources  and  resources  of  the  active  subproblem.  Simple  techniques 
such  as  exponential  smoothing  could  also  have  merit. 

•  Chapter  V  does  not  develop  any  explicit  modifications  of  the  Lagrangian  cascade 
to  reduce  the  proximal-Lagrangian  cascade  gap.  The  use  of  well-documented 
multiplier  search  methods  on  a  cascade  could  significantly  reduce  this  gap,  al¬ 
though  the  computational  burden  would  be  increased. 

C.  CONCLUSION 

Cascades  provide  a  useful  approximation  strategy  when  problem  structure  peimits, 
and  when  model  si2e  or  system  myopia  warrants.  This  research  formalizes  a  proximal 
cascade  approximation  on  a  class  of  problems,  develops  a  Lagrangian  cascade  bound  on 
that  approximation,  and  demonstrates  the  combined  approach  on  a  model  currently  in  use 
by  the  USAF. 
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